Apr 29 08:51:06 devstack cinder-volume[74985]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74985) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 08:51:06 devstack cinder-volume[74985]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74985) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 08:51:06 devstack cinder-volume[74985]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74985) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 08:51:07 devstack cinder-volume[74985]: INFO dbcounter [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Registered counter for database cinder Apr 29 08:51:07 devstack cinder-volume[74985]: DEBUG oslo_db.sqlalchemy.engines [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74985) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:51:07 devstack cinder-volume[74985]: DEBUG dbcounter [-] [74985] Writer thread running {{(pid=74985) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 08:51:07 devstack cinder-volume[74985]: INFO cinder.rpc [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 08:51:07 devstack cinder-volume[74985]: INFO cinder.rpc [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 08:51:07 devstack cinder-volume[74985]: DEBUG oslo_db.sqlalchemy.engines [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74985) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:51:07 devstack cinder-volume[74985]: INFO cinder.volume.manager [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Determined volume DB was empty at startup. Apr 29 08:51:07 devstack cinder-volume[74985]: DEBUG cinder.volume.manager [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74985) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 08:51:07 devstack cinder-volume[74985]: INFO cinder.volume.manager [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 08:51:07 devstack cinder-volume[74985]: WARNING stevedore.named [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 08:51:07 devstack cinder-volume[74985]: WARNING castellan.key_manager [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 08:51:07 devstack cinder-volume[74985]: WARNING cinder.keymgr.conf_key_mgr [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 08:51:07 devstack cinder-volume[74985]: DEBUG cinder.volume.drivers.lvm [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74985) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 29 08:51:07 devstack cinder-volume[74985]: DEBUG oslo_concurrency.processutils [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74985) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_concurrency.processutils [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.359s {{(pid=74985) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_db.sqlalchemy.engines [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74985) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:51:08 devstack cinder-volume[74985]: INFO cinder.rpc [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 29 08:51:08 devstack cinder-volume[74985]: INFO cinder.rpc [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 29 08:51:08 devstack cinder-volume[74985]: WARNING stevedore.named [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 08:51:08 devstack cinder-volume[74985]: WARNING castellan.key_manager [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 08:51:08 devstack cinder-volume[74985]: INFO cinder.volume.manager [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_db.sqlalchemy.engines [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74985) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:51:08 devstack cinder-volume[74985]: INFO oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Starting 1 workers Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Started child 75161 {{(pid=74985) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Full set of CONF: {{(pid=74985) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] ******************************************************************************** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Configuration options gathered from: {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] ================================================================================ {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] allow_availability_zone_fallback = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] allow_compression_on_image_upload = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] allowed_direct_url_schemes = [] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] api_rate_limit = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] auth_strategy = keystone {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] az_cache_duration = 3600 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_availability_zone = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_host = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_name = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_stats_polling_interval = 60 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backup_api_class = cinder.backup.api.API {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backup_name_template = backup-%s {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[75161]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backup_use_same_host = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backup_use_temp_snapshot = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] chap_password = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] chap_username = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cinder_internal_tenant_project_id = 77a2c7a30893470f8ea250165c92803b {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cinder_internal_tenant_user_id = 2bde9d49df574efab7de12f384784528 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cloned_volume_same_az = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cluster = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] compression_format = gzip {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] compute_api_class = cinder.compute.nova.API {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] config_dir = [] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] config_source = [] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] control_exchange = openstack {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] debug = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] default_availability_zone = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] default_group_type = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] default_volume_type = lvmdriver-1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] disk_geometry = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] driver_client_cert = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] driver_client_cert_key = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] driver_data_namespace = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] driver_ssl_cert_path = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] driver_ssl_cert_verify = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] driver_use_ssl = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] enable_force_upload = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] enable_new_services = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] enable_unsupported_driver = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] enabled_backends = ['lvmdriver-1'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] enforce_multipath_for_image_xfer = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] filter_function = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance_api_insecure = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance_api_servers = ['http://192.168.122.195/image'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance_api_ssl_compression = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance_ca_certificates_file = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance_catalog_info = image:glance:publicURL {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance_certfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance_keyfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance_num_retries = 3 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance_request_timeout = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] goodness_function = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] graceful_shutdown_timeout = 5 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] group_api_class = cinder.group.api.API {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] host = devstack {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] image_compress_on_upload = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] image_conversion_address_space_limit = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] image_conversion_cpu_limit = 60 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] image_conversion_disable = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] image_upload_use_cinder_backend = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] image_upload_use_internal_tenant = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] image_volume_cache_enabled = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] image_volume_cache_max_count = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] image_volume_cache_max_size_gb = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] init_host_max_objects_retrieval = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] instance_format = [instance: %(uuid)s] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] iscsi_target_flags = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] iscsi_write_cache = on {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] iser_helper = tgtadm {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] iser_ip_address = 192.168.122.195 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] iser_port = 3260 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] log_color = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] log_config_append = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] log_dir = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] log_file = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] log_options = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] log_rotate_interval = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] log_rotate_interval_type = days {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] log_rotation_type = none {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] max_age = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] max_logfile_count = 30 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] max_logfile_size_mb = 200 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[75161]: INFO cinder.volume.manager [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] max_over_subscription_ratio = 20.0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] message_reap_interval = 86400 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] message_ttl = 2592000 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] migration_create_volume_timeout_secs = 300 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] monkey_patch = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] monkey_patch_modules = [] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] my_ip = 192.168.122.195 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] no_snapshot_gb_quota = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] num_iser_scan_tries = 3 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] num_shell_tries = 3 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] num_volume_device_scan_tries = 3 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] nvmeof_conn_info_version = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] nvmet_ns_id = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] nvmet_port_id = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] osapi_max_limit = 1000 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] osapi_volume_ext_list = [] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] osapi_volume_listen_port = 8776 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] osapi_volume_use_ssl = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] osapi_volume_workers = 2 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] per_volume_size_limit = -1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] periodic_fuzzy_delay = 60 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] periodic_interval = 60 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] public_endpoint = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] publish_errors = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] quota_backup_gigabytes = 1000 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] quota_backups = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] quota_gigabytes = 1000 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] quota_groups = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] quota_snapshots = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] quota_volumes = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] rate_limit_burst = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] rate_limit_except_level = CRITICAL {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] rate_limit_interval = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] reinit_driver_count = 3 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] replication_device = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] report_discard_supported = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] report_interval = 120 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] reservation_clean_interval = 86400 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] reservation_expire = 86400 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] reserved_image_namespaces = [] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] reserved_percentage = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] rpc_response_timeout = 120 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] run_external_periodic_tasks = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] scst_target_driver = iscsi {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] scst_target_iqn_name = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] service_down_time = 720 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] shell_completion = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] snapshot_name_template = snapshot-%s {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] snapshot_same_host = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] split_loggers = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] state_path = /opt/stack/data/cinder {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] storage_availability_zone = nova {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] storage_protocol = iSCSI {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] syslog_log_facility = LOG_USER {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] target_helper = lioadm {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] target_ip_address = 192.168.122.195 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] target_port = 3260 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] target_protocol = iscsi {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] target_secondary_ip_addresses = [] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] trace_flags = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] transport_url = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] until_refresh = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] use_chap_auth = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] use_default_quota_class = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] use_journal = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] use_json = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] use_multipath_for_image_xfer = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] use_stderr = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] use_syslog = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] verify_glance_signatures = enabled {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volume_api_class = cinder.volume.api.API {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volume_backend_name = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volume_clear = zero {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volume_clear_ionice = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volume_clear_size = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volume_copy_bps_limit = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volume_dd_blocksize = 1M {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volume_name_template = volume-%s {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volume_service_inithost_offload = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volume_usage_audit_period = month {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] zoning_mode = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_concurrency.disable_process_locking = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.admin_password = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.admin_token = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.admin_user = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.auth_port = 35357 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.auth_protocol = https {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.auth_section = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.auth_type = password {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.auth_uri = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.auth_version = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.cache = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.certfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.identity_uri = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.include_service_catalog = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.insecure = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.interface = public {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.keyfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_password = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.076s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:08 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcache_username = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.region_name = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.service_type = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.195/identity {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.backend = dogpile.cache.null {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.backend_argument = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.backend_expiration_time = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.config_prefix = cache.oslo {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.debug_cache_backend = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.enable_retry_client = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.enable_socket_keepalive = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.enabled = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.enforce_fips_mode = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.expiration_time = 600 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.hashclient_retry_attempts = 2 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.memcache_dead_retry = 300 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.memcache_pool_maxsize = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.memcache_sasl_enabled = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.password = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.proxies = [] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.redis_db = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.redis_server = localhost:6379 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.retry_attempts = 2 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.retry_delay = 0.0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.socket_keepalive_count = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.socket_keepalive_idle = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.socket_keepalive_interval = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.socket_timeout = 1.0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.tls_allowed_ciphers = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.tls_cafile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.tls_certfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.tls_enabled = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.tls_keyfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cache.username = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] coordination.backend_url = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.asyncio_connection = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.asyncio_slave_connection = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.backend = sqlalchemy {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.connection = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.connection_debug = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.connection_parameters = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.connection_recycle_time = 3600 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:08 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.connection_trace = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.db_inc_retry_interval = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.db_max_retries = 20 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.db_max_retry_interval = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.db_retry_interval = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.max_overflow = 50 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.max_pool_size = 5 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.max_retries = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.mysql_wsrep_sync_wait = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.pool_timeout = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.retry_interval = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.slave_connection = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.sqlite_synchronous = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.synchronous_reader = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] database.use_db_reconnect = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler.connection_string = messaging:// {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler.enabled = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler.es_doc_type = notification {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler.es_scroll_size = 10000 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler.es_scroll_time = 2m {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler.filter_error_trace = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler.hmac_keys = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler.sentinel_service_name = mymaster {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler.socket_timeout = 0.1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler.trace_requests = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler.trace_sqlalchemy = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler_jaeger.process_tags = {} {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler_jaeger.service_name_prefix = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] profiler_otlp.service_name_prefix = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_policy.enforce_new_defaults = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: WARNING oslo_config.cfg [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_policy.enforce_scope = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_policy.policy_default_rule = default {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_policy.policy_file = policy.yaml {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] privsep_osbrick.group = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] privsep_osbrick.helper_command = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] privsep_osbrick.user = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cinder_sys_admin.group = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cinder_sys_admin.helper_command = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] cinder_sys_admin.user = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] service_user.auth_section = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] service_user.auth_type = password {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] service_user.cafile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] service_user.certfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] service_user.collect_timing = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] service_user.insecure = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] service_user.keyfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] service_user.send_service_user_token = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] service_user.split_loggers = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] service_user.timeout = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance.auth_section = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance.auth_type = password {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance.certfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance.collect_timing = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance.insecure = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance.keyfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance.region_name = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance.split_loggers = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] glance.timeout = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.backend_availability_zone = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.chap_password = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.chap_username = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.disk_geometry = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.driver_client_cert = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.driver_client_cert_key = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.driver_data_namespace = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.driver_use_ssl = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.extra_capabilities = {} {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.filter_function = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.goodness_function = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.iscsi_target_flags = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.iscsi_write_cache = on {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.iser_helper = tgtadm {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.iser_ip_address = 192.168.122.195 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.iser_port = 3260 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.lvm_mirrors = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.lvm_share_target = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.lvm_type = auto {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.num_shell_tries = 3 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.replication_device = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.report_discard_supported = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.reserved_percentage = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.target_helper = tgtadm {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.target_ip_address = 192.168.122.195 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.target_port = 3260 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.target_protocol = iscsi {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.trace_flags = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.unique_fqdn_network = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.use_chap_auth = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.volume_backend_name = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.volume_clear = zero {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.volume_clear_ionice = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.volume_clear_size = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.volume_group = cinder-volumes {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_reports.file_event_handler = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_reports.log_dir = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.backend_host = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.chap_password = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.chap_username = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.chiscsi_conf = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.disk_geometry = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.driver_client_cert = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.driver_use_ssl = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.extra_capabilities = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.filter_function = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.goodness_function = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack sudo[75165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.iser_helper = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.iser_ip_address = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack sudo[75165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.iser_port = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.lvm_conf_file = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.lvm_mirrors = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.lvm_share_target = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.lvm_type = auto {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.num_shell_tries = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.nvmet_port_id = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.replication_device = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.report_discard_supported = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.reserved_percentage = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.scst_target_driver = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.storage_protocol = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.target_helper = lioadm {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.target_ip_address = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.target_port = 3260 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.target_protocol = iscsi {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.trace_flags = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.use_chap_auth = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.volume_clear = zero {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.volume_clear_size = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] lvmdriver-1.volumes_dir = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.ssl = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_notifications.driver = [] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_notifications.retry = -1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] key_manager.fixed_key = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.barbican_api_version = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.barbican_endpoint = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.barbican_endpoint_type = public {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.barbican_region_name = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.cafile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.certfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.collect_timing = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.insecure = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.keyfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.number_of_retries = 60 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.retry_delay = 1 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.send_service_user_token = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.split_loggers = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.timeout = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.verify_ssl = True {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican.verify_ssl_path = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican_service_user.auth_section = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican_service_user.auth_type = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican_service_user.cafile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican_service_user.certfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican_service_user.collect_timing = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican_service_user.insecure = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican_service_user.keyfile = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican_service_user.split_loggers = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] barbican_service_user.timeout = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] vault.approle_role_id = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] vault.approle_secret_id = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] vault.kv_mountpoint = secret {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] vault.kv_path = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] vault.kv_version = 2 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] vault.namespace = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] vault.root_token_id = **** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] vault.ssl_ca_crt_file = None {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] vault.timeout = 60.0 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] vault.use_ssl = False {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:51:08 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] ******************************************************************************** {{(pid=74985) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 08:51:09 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.804s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:09 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:09 devstack sudo[75165]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:09 devstack sudo[75342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:51:09 devstack sudo[75342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:10 devstack sudo[75342]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:10 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.728s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:10 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 08:51:10 devstack cinder-volume[75161]: INFO cinder.brick.local_dev.lvm [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 29 08:51:10 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:10 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:10 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:10 devstack sudo[75560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 08:51:10 devstack sudo[75560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:10 devstack sudo[75560]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:10 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.719s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:10 devstack cinder-volume[75161]: DEBUG cinder.brick.local_dev.lvm [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75161) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 29 08:51:10 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:10 devstack sudo[75733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:51:10 devstack sudo[75733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:12 devstack sudo[75733]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:12 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.077s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:12 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:12 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:12 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:12 devstack sudo[75939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:51:12 devstack sudo[75939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:12 devstack sudo[75939]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:12 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.829s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:12 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:12 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:12 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:12 devstack sudo[75945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 29 08:51:12 devstack sudo[75945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:13 devstack sudo[75945]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:13 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.611s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:13 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:13 devstack sudo[75955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 08:51:13 devstack sudo[75955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:14 devstack sudo[75955]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:14 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:14 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:14 devstack sudo[75962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 08:51:14 devstack sudo[75962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:14 devstack sudo[75962]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:14 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:14 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:14 devstack sudo[75966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 08:51:14 devstack sudo[75966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:15 devstack sudo[75966]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:15 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:15 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:15 devstack sudo[75972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:51:15 devstack sudo[75972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:16 devstack sudo[75972]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:16 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:16 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:16 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:16 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:16 devstack sudo[75976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:51:16 devstack sudo[75976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:16 devstack sudo[75976]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:16 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.600s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:16 devstack cinder-volume[75161]: INFO cinder.volume.drivers.lvm [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 29 08:51:16 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:16 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:16 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:16 devstack sudo[75985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:51:16 devstack sudo[75985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:17 devstack sudo[75985]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:17 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.918s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:17 devstack cinder-volume[75161]: DEBUG cinder.volume.drivers.lvm [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Updating volume stats {{(pid=75161) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 08:51:17 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:17 devstack sudo[76105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 08:51:17 devstack sudo[76105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:18 devstack sudo[76105]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:18 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:18 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:18 devstack sudo[76113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 08:51:18 devstack sudo[76113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:18 devstack cinder-volume[74985]: DEBUG dbcounter [-] [74985] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74985) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:51:18 devstack sudo[76113]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:18 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:18 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:18 devstack sudo[76255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:51:18 devstack sudo[76255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:19 devstack sudo[76255]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:19 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:19 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:19 devstack sudo[76258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 08:51:19 devstack sudo[76258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:20 devstack sudo[76258]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:20 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:20 devstack cinder-volume[75161]: INFO cinder.volume.driver [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Driver hasn't implemented _init_vendor_properties() Apr 29 08:51:20 devstack cinder-volume[75161]: DEBUG cinder.volume.driver [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75161) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 08:51:20 devstack cinder-volume[75161]: DEBUG oslo_db.sqlalchemy.engines [None req-86360391-7936-4723-a93c-187d9ceab83c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75161) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:51:20 devstack cinder-volume[75161]: DEBUG dbcounter [-] [75161] Writer thread running {{(pid=75161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 08:51:20 devstack cinder-volume[75161]: DEBUG cinder.db.sqlalchemy.api [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Building query based on filter {{(pid=75161) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 08:51:20 devstack cinder-volume[75161]: DEBUG cinder.image.image_utils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75161) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 08:51:20 devstack cinder-volume[75161]: INFO cinder.keymgr.migration [None req-486f77be-a6fe-4e57-becc-e0b1419ef02e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 08:51:20 devstack cinder-volume[75161]: DEBUG cinder.volume.drivers.lvm [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Updating volume stats {{(pid=75161) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 08:51:20 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:20 devstack sudo[76265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 08:51:20 devstack sudo[76265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:20 devstack sudo[76265]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:20 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:20 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:20 devstack sudo[76268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 08:51:20 devstack sudo[76268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:21 devstack sudo[76268]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:21 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:21 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:21 devstack sudo[76271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:51:21 devstack sudo[76271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:22 devstack sudo[76271]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:22 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:22 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:22 devstack sudo[76274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 08:51:22 devstack sudo[76274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:22 devstack sudo[76274]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:22 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:22 devstack cinder-volume[75161]: DEBUG cinder.manager [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Notifying Schedulers of capabilities ... {{(pid=75161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:51:22 devstack cinder-volume[75161]: INFO cinder.volume.manager [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Driver initialization completed successfully. Apr 29 08:51:22 devstack cinder-volume[75161]: INFO cinder.manager [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Initiating service 2 cleanup Apr 29 08:51:22 devstack cinder-volume[75161]: INFO cinder.manager [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Service 2 cleanup completed. Apr 29 08:51:22 devstack cinder-volume[75161]: DEBUG cinder.service [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Creating RPC server for service cinder-volume {{(pid=75161) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 08:51:22 devstack cinder-volume[75161]: DEBUG cinder.service [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75161) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 08:51:22 devstack cinder-volume[75161]: INFO cinder.volume.manager [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 29 08:51:22 devstack cinder-volume[75161]: DEBUG cinder.volume.drivers.lvm [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Updating volume stats {{(pid=75161) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 08:51:22 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:22 devstack sudo[76278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 08:51:22 devstack sudo[76278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:23 devstack sudo[76278]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:23 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:23 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:23 devstack sudo[76286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 08:51:23 devstack sudo[76286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:24 devstack sudo[76286]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:24 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:24 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:24 devstack sudo[76290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:51:24 devstack sudo[76290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:24 devstack sudo[76290]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:24 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:24 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:51:24 devstack sudo[76293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 08:51:24 devstack sudo[76293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:51:25 devstack sudo[76293]: pam_unix(sudo:session): session closed for user root Apr 29 08:51:25 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-86360391-7936-4723-a93c-187d9ceab83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:51:25 devstack cinder-volume[75161]: INFO cinder.volume.manager [None req-86360391-7936-4723-a93c-187d9ceab83c None None] Driver post RPC initialization completed successfully. Apr 29 08:51:35 devstack cinder-volume[75161]: DEBUG dbcounter [-] [75161] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:51:35 devstack cinder-volume[75161]: DEBUG dbcounter [-] [75161] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:52:18 devstack cinder-volume[75161]: DEBUG oslo_service.periodic_task [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 08:52:18 devstack cinder-volume[75161]: DEBUG cinder.volume.drivers.lvm [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Updating volume stats {{(pid=75161) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 08:52:18 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:52:18 devstack sudo[77989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 08:52:18 devstack sudo[77989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:52:19 devstack sudo[77989]: pam_unix(sudo:session): session closed for user root Apr 29 08:52:19 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:52:19 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:52:19 devstack sudo[77992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 08:52:19 devstack sudo[77992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:52:19 devstack sudo[77992]: pam_unix(sudo:session): session closed for user root Apr 29 08:52:19 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:52:20 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:52:20 devstack sudo[77995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:52:20 devstack sudo[77995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:52:20 devstack sudo[77995]: pam_unix(sudo:session): session closed for user root Apr 29 08:52:20 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:52:20 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:52:20 devstack sudo[78096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 08:52:20 devstack sudo[78096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:52:21 devstack sudo[78096]: pam_unix(sudo:session): session closed for user root Apr 29 08:52:21 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:52:21 devstack cinder-volume[75161]: DEBUG cinder.manager [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Notifying Schedulers of capabilities ... {{(pid=75161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:53:18 devstack cinder-volume[75161]: DEBUG oslo_service.periodic_task [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 08:53:18 devstack cinder-volume[75161]: DEBUG cinder.volume.drivers.lvm [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Updating volume stats {{(pid=75161) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 08:53:18 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:53:18 devstack sudo[81305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 08:53:18 devstack sudo[81305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:53:19 devstack sudo[81305]: pam_unix(sudo:session): session closed for user root Apr 29 08:53:19 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:53:19 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:53:19 devstack sudo[81313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 08:53:19 devstack sudo[81313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:53:19 devstack sudo[81313]: pam_unix(sudo:session): session closed for user root Apr 29 08:53:19 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:53:19 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:53:19 devstack sudo[81328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:53:19 devstack sudo[81328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:53:20 devstack sudo[81328]: pam_unix(sudo:session): session closed for user root Apr 29 08:53:20 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.574s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:53:20 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:53:20 devstack sudo[81334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 08:53:20 devstack sudo[81334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:53:20 devstack sudo[81334]: pam_unix(sudo:session): session closed for user root Apr 29 08:53:20 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.564s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:53:20 devstack cinder-volume[75161]: DEBUG cinder.manager [None req-a3026244-4cd6-422b-adba-19960d4b3ee6 None None] Notifying Schedulers of capabilities ... {{(pid=75161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:53:35 devstack cinder-volume[75161]: DEBUG dbcounter [-] [75161] Writing DB stats cinder:SELECT=1 {{(pid=75161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:53:35 devstack cinder-volume[75161]: DEBUG dbcounter [-] [75161] Writing DB stats cinder:UPDATE=1 {{(pid=75161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:54:14 devstack cinder-volume[74985]: INFO oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Caught SIGTERM, stopping children Apr 29 08:54:14 devstack cinder-volume[74985]: DEBUG oslo_concurrency.lockutils [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Acquiring lock "singleton_lock" {{(pid=74985) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 08:54:14 devstack cinder-volume[74985]: DEBUG oslo_concurrency.lockutils [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Acquired lock "singleton_lock" {{(pid=74985) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 08:54:14 devstack cinder-volume[74985]: DEBUG oslo_concurrency.lockutils [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Releasing lock "singleton_lock" {{(pid=74985) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 08:54:14 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Stop services. {{(pid=74985) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 08:54:14 devstack cinder-volume[74985]: DEBUG oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Killing children. {{(pid=74985) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 08:54:14 devstack cinder-volume[74985]: INFO oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Waiting on 1 children to exit Apr 29 08:54:17 devstack cinder-volume[75161]: DEBUG oslo_concurrency.lockutils [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Acquiring lock "singleton_lock" {{(pid=75161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 08:54:17 devstack cinder-volume[75161]: DEBUG oslo_concurrency.lockutils [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Acquired lock "singleton_lock" {{(pid=75161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 08:54:17 devstack cinder-volume[75161]: DEBUG oslo_concurrency.lockutils [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Releasing lock "singleton_lock" {{(pid=75161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 08:54:17 devstack cinder-volume[75161]: WARNING amqp [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 08:54:17 devstack cinder-volume[75161]: WARNING amqp [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 08:54:17 devstack cinder-volume[74985]: INFO oslo_service.backend._eventlet.service [None req-65c803b7-097e-498c-86c3-b3e198a6eab3 None None] Child 75161 exited with status 0 Apr 29 08:54:20 devstack cinder-volume[82887]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 08:54:20 devstack cinder-volume[82887]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 08:54:20 devstack cinder-volume[82887]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 08:54:20 devstack cinder-volume[82887]: INFO dbcounter [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Registered counter for database cinder Apr 29 08:54:20 devstack cinder-volume[82887]: DEBUG oslo_db.sqlalchemy.engines [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG dbcounter [-] [82887] Writer thread running {{(pid=82887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 08:54:21 devstack cinder-volume[82887]: INFO cinder.rpc [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 08:54:21 devstack cinder-volume[82887]: INFO cinder.rpc [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_db.sqlalchemy.engines [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:54:21 devstack cinder-volume[82887]: INFO cinder.volume.manager [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Determined volume DB was empty at startup. Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG cinder.volume.manager [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82887) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 08:54:21 devstack cinder-volume[82887]: INFO cinder.volume.manager [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 08:54:21 devstack cinder-volume[82887]: WARNING stevedore.named [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 08:54:21 devstack cinder-volume[82887]: WARNING castellan.key_manager [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 08:54:21 devstack cinder-volume[82887]: WARNING cinder.keymgr.conf_key_mgr [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 08:54:21 devstack cinder-volume[82887]: INFO cinder.volume.manager [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_db.sqlalchemy.engines [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:54:21 devstack cinder-volume[82887]: INFO oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Starting 1 workers Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Started child 83170 {{(pid=82887) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Full set of CONF: {{(pid=82887) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] ******************************************************************************** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 08:54:21 devstack cinder-volume[83170]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Configuration options gathered from: {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] ================================================================================ {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] allow_availability_zone_fallback = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] allow_compression_on_image_upload = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] allowed_direct_url_schemes = [] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] api_rate_limit = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] auth_strategy = keystone {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_availability_zone = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_host = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_name = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_stats_polling_interval = 60 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backup_api_class = cinder.backup.api.API {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backup_name_template = backup-%s {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backup_use_same_host = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backup_use_temp_snapshot = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] chap_password = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] chap_username = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cinder_internal_tenant_project_id = 77a2c7a30893470f8ea250165c92803b {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cinder_internal_tenant_user_id = 2bde9d49df574efab7de12f384784528 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cluster = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] compression_format = gzip {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] compute_api_class = cinder.compute.nova.API {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] config_dir = [] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] config_source = [] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] control_exchange = openstack {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] debug = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] default_availability_zone = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] default_group_type = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] default_volume_type = QuobyteHD {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] disk_geometry = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] driver_client_cert = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] driver_client_cert_key = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] driver_data_namespace = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] driver_ssl_cert_path = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] driver_ssl_cert_verify = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] driver_use_ssl = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] enable_new_services = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] enable_unsupported_driver = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:21 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] enabled_backends = ['QuobyteHD'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] enforce_multipath_for_image_xfer = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] filter_function = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance_api_insecure = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance_api_servers = ['http://192.168.122.195/image'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance_api_ssl_compression = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance_ca_certificates_file = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[83170]: INFO cinder.volume.manager [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance_catalog_info = image:glance:publicURL {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[83170]: DEBUG cinder.volume.drivers.remotefs [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83170) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance_certfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance_keyfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance_num_retries = 3 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance_request_timeout = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] goodness_function = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] graceful_shutdown_timeout = 5 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] group_api_class = cinder.group.api.API {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] host = devstack {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] image_compress_on_upload = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] image_conversion_address_space_limit = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] image_conversion_cpu_limit = 60 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] image_conversion_disable = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] image_upload_use_cinder_backend = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] image_upload_use_internal_tenant = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] image_volume_cache_enabled = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] image_volume_cache_max_count = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] image_volume_cache_max_size_gb = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] init_host_max_objects_retrieval = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] instance_format = [instance: %(uuid)s] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] iscsi_target_flags = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] iscsi_write_cache = on {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] iser_helper = tgtadm {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] iser_ip_address = 192.168.122.195 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] iser_port = 3260 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] log_color = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] log_config_append = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] log_dir = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] log_file = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] log_options = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] log_rotate_interval = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] log_rotate_interval_type = days {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] log_rotation_type = none {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] max_age = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] max_logfile_count = 30 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] max_logfile_size_mb = 200 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] max_over_subscription_ratio = 20.0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] message_reap_interval = 86400 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] message_ttl = 2592000 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] migration_create_volume_timeout_secs = 300 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] monkey_patch = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] monkey_patch_modules = [] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] my_ip = 192.168.122.195 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] no_snapshot_gb_quota = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] num_iser_scan_tries = 3 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] num_shell_tries = 3 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] num_volume_device_scan_tries = 3 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] nvmeof_conn_info_version = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] nvmet_ns_id = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] nvmet_port_id = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] osapi_max_limit = 1000 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] osapi_volume_ext_list = [] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] osapi_volume_listen_port = 8776 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] osapi_volume_use_ssl = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] osapi_volume_workers = 2 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] per_volume_size_limit = -1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] periodic_fuzzy_delay = 60 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] periodic_interval = 60 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] public_endpoint = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] publish_errors = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] quota_backup_gigabytes = 1000 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] quota_backups = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] quota_gigabytes = 1000 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] quota_groups = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] quota_snapshots = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] quota_volumes = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] rate_limit_burst = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] rate_limit_except_level = CRITICAL {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] rate_limit_interval = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] reinit_driver_count = 3 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] replication_device = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] report_discard_supported = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] report_interval = 120 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] reservation_clean_interval = 86400 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] reservation_expire = 86400 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] reserved_image_namespaces = [] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] reserved_percentage = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] rpc_response_timeout = 120 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] run_external_periodic_tasks = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] scst_target_driver = iscsi {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] scst_target_iqn_name = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] service_down_time = 720 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] shell_completion = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] snapshot_name_template = snapshot-%s {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] split_loggers = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] state_path = /opt/stack/data/cinder {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] storage_availability_zone = nova {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] storage_protocol = iSCSI {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] syslog_log_facility = LOG_USER {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] target_helper = lioadm {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] target_ip_address = 192.168.122.195 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] target_port = 3260 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] target_protocol = iscsi {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] target_secondary_ip_addresses = [] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] trace_flags = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] transport_url = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] until_refresh = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] use_chap_auth = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] use_default_quota_class = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] use_journal = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] use_json = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] use_multipath_for_image_xfer = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] use_stderr = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] use_syslog = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] verify_glance_signatures = enabled {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volume_api_class = cinder.volume.api.API {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volume_backend_name = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volume_clear = zero {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volume_clear_ionice = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volume_clear_size = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volume_copy_bps_limit = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volume_dd_blocksize = 1M {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volume_name_template = volume-%s {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volume_service_inithost_offload = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volume_usage_audit_period = month {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] zoning_mode = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_concurrency.disable_process_locking = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.admin_password = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.admin_token = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.admin_user = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.auth_port = 35357 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.auth_protocol = https {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.auth_section = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.auth_type = password {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.auth_uri = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.auth_version = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.cache = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.certfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.identity_uri = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.include_service_catalog = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.insecure = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.interface = public {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.keyfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_password = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcache_username = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.region_name = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.service_type = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.195/identity {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.backend = dogpile.cache.null {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.backend_argument = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.backend_expiration_time = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.config_prefix = cache.oslo {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.debug_cache_backend = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.enable_retry_client = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.enable_socket_keepalive = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.enabled = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.enforce_fips_mode = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.expiration_time = 600 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.hashclient_retry_attempts = 2 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.memcache_dead_retry = 300 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.memcache_pool_maxsize = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.memcache_sasl_enabled = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.password = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.proxies = [] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.redis_db = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.redis_server = localhost:6379 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.retry_attempts = 2 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.retry_delay = 0.0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.socket_keepalive_count = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.socket_keepalive_idle = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.socket_keepalive_interval = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.socket_timeout = 1.0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.tls_allowed_ciphers = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.tls_cafile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.tls_certfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.tls_enabled = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.tls_keyfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cache.username = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] coordination.backend_url = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.asyncio_connection = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.asyncio_slave_connection = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.backend = sqlalchemy {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.connection = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.connection_debug = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.connection_parameters = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.connection_recycle_time = 3600 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.connection_trace = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.db_inc_retry_interval = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.db_max_retries = 20 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.db_max_retry_interval = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.db_retry_interval = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.max_overflow = 50 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[83170]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83170) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.max_pool_size = 5 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.max_retries = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.mysql_wsrep_sync_wait = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.pool_timeout = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.retry_interval = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.slave_connection = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[83170]: WARNING cinder.volume.drivers.quobyte [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 08:54:22 devstack cinder-volume[83170]: WARNING cinder.volume.drivers.quobyte [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 08:54:22 devstack cinder-volume[83170]: DEBUG oslo_concurrency.processutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Running cmd (subprocess): mount.quobyte {{(pid=83170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.sqlite_synchronous = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.synchronous_reader = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] database.use_db_reconnect = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler.connection_string = messaging:// {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler.enabled = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler.es_doc_type = notification {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler.es_scroll_size = 10000 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler.es_scroll_time = 2m {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler.filter_error_trace = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler.hmac_keys = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler.sentinel_service_name = mymaster {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler.socket_timeout = 0.1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler.trace_requests = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler.trace_sqlalchemy = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler_jaeger.process_tags = {} {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler_jaeger.service_name_prefix = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] profiler_otlp.service_name_prefix = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_policy.enforce_new_defaults = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: WARNING oslo_config.cfg [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_policy.enforce_scope = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_policy.policy_default_rule = default {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_policy.policy_file = policy.yaml {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] privsep_osbrick.group = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] privsep_osbrick.helper_command = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] privsep_osbrick.user = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cinder_sys_admin.group = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cinder_sys_admin.helper_command = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] cinder_sys_admin.user = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] service_user.auth_section = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] service_user.auth_type = password {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] service_user.cafile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] service_user.certfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] service_user.collect_timing = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] service_user.insecure = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] service_user.keyfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] service_user.send_service_user_token = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] service_user.split_loggers = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] service_user.timeout = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance.auth_section = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance.auth_type = password {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance.certfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance.collect_timing = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance.insecure = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance.keyfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance.region_name = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance.split_loggers = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] glance.timeout = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.backend_availability_zone = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[83170]: DEBUG oslo_concurrency.processutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] CMD "mount.quobyte" returned: 1 in 0.101s {{(pid=83170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:54:22 devstack cinder-volume[83170]: DEBUG oslo_concurrency.lockutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83170) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:54:22 devstack cinder-volume[83170]: DEBUG oslo_concurrency.lockutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83170) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:54:22 devstack cinder-volume[83170]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83170) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:54:22 devstack cinder-volume[83170]: INFO cinder.volume.drivers.quobyte [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa ... Apr 29 08:54:22 devstack cinder-volume[83170]: DEBUG oslo_concurrency.processutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce -c /etc/quobyte/client-cinder.cfg {{(pid=83170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.chap_password = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.chap_username = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.disk_geometry = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.driver_client_cert = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.driver_client_cert_key = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.driver_data_namespace = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.driver_use_ssl = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.extra_capabilities = {} {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.filter_function = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.goodness_function = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.iscsi_target_flags = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.iscsi_write_cache = on {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.iser_helper = tgtadm {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.iser_ip_address = 192.168.122.195 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.iser_port = 3260 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nas_host = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack sudo[83187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce -c /etc/quobyte/client-cinder.cfg Apr 29 08:54:22 devstack sudo[83187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nas_login = admin {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nas_mount_options = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nas_password = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nas_private_key = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nas_share_path = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.num_shell_tries = 3 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.quobyte_volume_url = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.replication_device = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.report_discard_supported = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.reserved_percentage = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.target_helper = tgtadm {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.target_ip_address = 192.168.122.195 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.target_port = 3260 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.target_protocol = iscsi {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.trace_flags = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.unique_fqdn_network = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.use_chap_auth = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.volume_backend_name = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.volume_clear = zero {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.volume_clear_ionice = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.volume_clear_size = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_reports.file_event_handler = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_reports.log_dir = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.backend_availability_zone = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.backend_host = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.chap_password = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.chap_username = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.chiscsi_conf = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.disk_geometry = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.driver_client_cert = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.driver_data_namespace = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.driver_use_ssl = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.extra_capabilities = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.filter_function = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.goodness_function = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.iser_helper = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.iser_ip_address = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.iser_port = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.iser_target_prefix = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nas_host = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nas_login = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nas_mount_options = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nas_password = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nas_private_key = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nas_share_path = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nas_ssh_port = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.num_shell_tries = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.nvmet_port_id = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.replication_device = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.report_discard_supported = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.reserved_percentage = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.scst_target_driver = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.storage_protocol = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.target_helper = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.target_ip_address = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.target_port = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.target_prefix = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.target_protocol = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.trace_flags = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.use_chap_auth = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.volume_clear = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.volume_clear_size = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] QuobyteHD.volumes_dir = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.ssl = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_notifications.driver = [] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_notifications.retry = -1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] key_manager.fixed_key = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.barbican_api_version = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.barbican_endpoint = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.barbican_endpoint_type = public {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.barbican_region_name = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.cafile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.certfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.collect_timing = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.insecure = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.keyfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.number_of_retries = 60 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.retry_delay = 1 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.send_service_user_token = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.split_loggers = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.timeout = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.verify_ssl = True {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican.verify_ssl_path = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican_service_user.auth_section = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican_service_user.auth_type = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican_service_user.cafile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican_service_user.certfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican_service_user.collect_timing = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican_service_user.insecure = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican_service_user.keyfile = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican_service_user.split_loggers = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] barbican_service_user.timeout = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] vault.approle_role_id = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] vault.approle_secret_id = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] vault.kv_mountpoint = secret {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] vault.kv_path = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] vault.kv_version = 2 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] vault.namespace = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] vault.root_token_id = **** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] vault.ssl_ca_crt_file = None {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] vault.timeout = 60.0 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] vault.use_ssl = False {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:22 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] ******************************************************************************** {{(pid=82887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 08:54:23 devstack sudo[83187]: pam_unix(sudo:session): session closed for user root Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG oslo_concurrency.processutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.838s {{(pid=83170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:54:23 devstack cinder-volume[83170]: INFO cinder.volume.drivers.quobyte [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa succeeded Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83170) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG oslo_concurrency.lockutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.851s {{(pid=83170) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG oslo_concurrency.processutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:54:23 devstack sudo[83260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:54:23 devstack sudo[83260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:54:23 devstack sudo[83260]: pam_unix(sudo:session): session closed for user root Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG oslo_concurrency.processutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.626s {{(pid=83170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:54:23 devstack cinder-volume[83170]: INFO cinder.volume.driver [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG cinder.volume.driver [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6515731811523, 'free_capacity_gb': 1775.6515731811523, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83170) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG oslo_db.sqlalchemy.engines [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83170) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG dbcounter [-] [83170] Writer thread running {{(pid=83170) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG cinder.db.sqlalchemy.api [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Building query based on filter {{(pid=83170) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG cinder.image.image_utils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83170) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 08:54:23 devstack cinder-volume[83170]: INFO cinder.keymgr.migration [None req-04e49a20-02e5-4b91-9bbe-4a5d021de710 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG oslo_concurrency.lockutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83170) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG oslo_concurrency.lockutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83170) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83170) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83170) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG oslo_concurrency.lockutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83170) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:54:23 devstack cinder-volume[83170]: DEBUG oslo_concurrency.processutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:54:23 devstack sudo[83263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:54:23 devstack sudo[83263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:54:24 devstack sudo[83263]: pam_unix(sudo:session): session closed for user root Apr 29 08:54:24 devstack cinder-volume[83170]: DEBUG oslo_concurrency.processutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.576s {{(pid=83170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:54:24 devstack cinder-volume[83170]: DEBUG cinder.manager [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Notifying Schedulers of capabilities ... {{(pid=83170) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:54:24 devstack cinder-volume[83170]: INFO cinder.volume.manager [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Driver initialization completed successfully. Apr 29 08:54:24 devstack cinder-volume[83170]: INFO cinder.manager [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Initiating service 3 cleanup Apr 29 08:54:24 devstack cinder-volume[83170]: INFO cinder.manager [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Service 3 cleanup completed. Apr 29 08:54:24 devstack cinder-volume[83170]: DEBUG cinder.service [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Creating RPC server for service cinder-volume {{(pid=83170) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 08:54:24 devstack cinder-volume[83170]: DEBUG cinder.service [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83170) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 08:54:24 devstack cinder-volume[83170]: INFO cinder.volume.manager [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 08:54:24 devstack cinder-volume[83170]: DEBUG oslo_concurrency.lockutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83170) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:54:24 devstack cinder-volume[83170]: DEBUG oslo_concurrency.lockutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83170) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:54:24 devstack cinder-volume[83170]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83170) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:54:24 devstack cinder-volume[83170]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83170) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:54:24 devstack cinder-volume[83170]: DEBUG oslo_concurrency.lockutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83170) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:54:24 devstack cinder-volume[83170]: DEBUG oslo_concurrency.processutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:54:24 devstack sudo[83268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:54:24 devstack sudo[83268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:54:25 devstack sudo[83268]: pam_unix(sudo:session): session closed for user root Apr 29 08:54:25 devstack cinder-volume[83170]: DEBUG oslo_concurrency.processutils [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.603s {{(pid=83170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:54:25 devstack cinder-volume[83170]: INFO cinder.volume.manager [None req-f4ac8968-aa58-4536-98e1-b8f6a2175523 None None] Driver post RPC initialization completed successfully. Apr 29 08:54:28 devstack cinder-volume[82887]: INFO oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Caught SIGTERM, stopping children Apr 29 08:54:28 devstack cinder-volume[82887]: DEBUG oslo_concurrency.lockutils [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Acquiring lock "singleton_lock" {{(pid=82887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 08:54:28 devstack cinder-volume[82887]: DEBUG oslo_concurrency.lockutils [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Acquired lock "singleton_lock" {{(pid=82887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 08:54:28 devstack cinder-volume[82887]: DEBUG oslo_concurrency.lockutils [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Releasing lock "singleton_lock" {{(pid=82887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 08:54:28 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Stop services. {{(pid=82887) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 08:54:28 devstack cinder-volume[82887]: DEBUG oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Killing children. {{(pid=82887) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 08:54:28 devstack cinder-volume[82887]: INFO oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Waiting on 1 children to exit Apr 29 08:54:28 devstack cinder-volume[83170]: DEBUG oslo_concurrency.lockutils [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Acquiring lock "singleton_lock" {{(pid=83170) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 08:54:28 devstack cinder-volume[83170]: DEBUG oslo_concurrency.lockutils [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Acquired lock "singleton_lock" {{(pid=83170) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 08:54:28 devstack cinder-volume[83170]: DEBUG oslo_concurrency.lockutils [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Releasing lock "singleton_lock" {{(pid=83170) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 08:54:28 devstack cinder-volume[83170]: WARNING amqp [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 08:54:28 devstack cinder-volume[83170]: WARNING amqp [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 08:54:28 devstack cinder-volume[82887]: INFO oslo_service.backend._eventlet.service [None req-35643049-36f6-41f8-9313-d96ae882ba83 None None] Child 83170 exited with status 0 Apr 29 08:54:31 devstack cinder-volume[83483]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 08:54:31 devstack cinder-volume[83483]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 08:54:31 devstack cinder-volume[83483]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 08:54:32 devstack cinder-volume[83483]: INFO dbcounter [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Registered counter for database cinder Apr 29 08:54:32 devstack cinder-volume[83483]: DEBUG oslo_db.sqlalchemy.engines [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83483) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG dbcounter [-] [83483] Writer thread running {{(pid=83483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 08:54:33 devstack cinder-volume[83483]: INFO cinder.rpc [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 08:54:33 devstack cinder-volume[83483]: INFO cinder.rpc [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_db.sqlalchemy.engines [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83483) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:54:33 devstack cinder-volume[83483]: INFO cinder.volume.manager [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Determined volume DB was empty at startup. Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG cinder.volume.manager [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83483) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 08:54:33 devstack cinder-volume[83483]: WARNING stevedore.named [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 08:54:33 devstack cinder-volume[83483]: WARNING castellan.key_manager [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 08:54:33 devstack cinder-volume[83483]: WARNING cinder.keymgr.conf_key_mgr [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 08:54:33 devstack cinder-volume[83483]: INFO cinder.volume.manager [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_db.sqlalchemy.engines [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83483) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:54:33 devstack cinder-volume[83483]: INFO oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Starting 1 workers Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Started child 83712 {{(pid=83483) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Full set of CONF: {{(pid=83483) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] ******************************************************************************** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Configuration options gathered from: {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 08:54:33 devstack cinder-volume[83712]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] ================================================================================ {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] allow_availability_zone_fallback = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] allow_compression_on_image_upload = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] allowed_direct_url_schemes = [] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] api_rate_limit = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] auth_strategy = keystone {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_availability_zone = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_host = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_name = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_stats_polling_interval = 60 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backup_api_class = cinder.backup.api.API {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backup_name_template = backup-%s {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backup_use_same_host = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backup_use_temp_snapshot = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] chap_password = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] chap_username = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cinder_internal_tenant_project_id = 77a2c7a30893470f8ea250165c92803b {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cinder_internal_tenant_user_id = 2bde9d49df574efab7de12f384784528 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cluster = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] compression_format = gzip {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] compute_api_class = cinder.compute.nova.API {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] config_dir = [] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] config_source = [] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] control_exchange = openstack {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] debug = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] default_availability_zone = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] default_group_type = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] default_volume_type = QuobyteHD {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] disk_geometry = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] driver_client_cert = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] driver_client_cert_key = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] driver_data_namespace = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] driver_ssl_cert_path = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] driver_ssl_cert_verify = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] driver_use_ssl = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] enable_new_services = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] enable_unsupported_driver = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] enabled_backends = ['QuobyteHD'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] enforce_multipath_for_image_xfer = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] filter_function = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance_api_insecure = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance_api_servers = ['http://192.168.122.195/image'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance_api_ssl_compression = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance_ca_certificates_file = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance_catalog_info = image:glance:publicURL {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance_certfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance_keyfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance_num_retries = 3 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance_request_timeout = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] goodness_function = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] graceful_shutdown_timeout = 5 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] group_api_class = cinder.group.api.API {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] host = devstack {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] image_compress_on_upload = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] image_conversion_address_space_limit = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] image_conversion_cpu_limit = 60 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] image_conversion_disable = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] image_upload_use_cinder_backend = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] image_upload_use_internal_tenant = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] image_volume_cache_enabled = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] image_volume_cache_max_count = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] image_volume_cache_max_size_gb = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] init_host_max_objects_retrieval = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] instance_format = [instance: %(uuid)s] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] iscsi_target_flags = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 08:54:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83712) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] iscsi_write_cache = on {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] iser_helper = tgtadm {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] iser_ip_address = 192.168.122.195 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] iser_port = 3260 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] log_color = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] log_config_append = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] log_dir = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] log_file = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] log_options = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] log_rotate_interval = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] log_rotate_interval_type = days {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] log_rotation_type = none {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] max_age = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] max_logfile_count = 30 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] max_logfile_size_mb = 200 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] max_over_subscription_ratio = 20.0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] message_reap_interval = 86400 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] message_ttl = 2592000 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] migration_create_volume_timeout_secs = 300 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] monkey_patch = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] monkey_patch_modules = [] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] my_ip = 192.168.122.195 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] no_snapshot_gb_quota = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] num_iser_scan_tries = 3 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] num_shell_tries = 3 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] num_volume_device_scan_tries = 3 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] nvmeof_conn_info_version = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] nvmet_ns_id = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] nvmet_port_id = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] osapi_max_limit = 1000 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] osapi_volume_ext_list = [] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] osapi_volume_listen = 0.0.0.0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] osapi_volume_listen_port = 8776 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] osapi_volume_use_ssl = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] osapi_volume_workers = 2 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] per_volume_size_limit = -1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] periodic_fuzzy_delay = 60 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] periodic_interval = 60 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] project_id_regex = [0-9a-f\-]+ {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] public_endpoint = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] publish_errors = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] quota_backup_gigabytes = 1000 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] quota_backups = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] quota_gigabytes = 1000 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] quota_groups = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] quota_snapshots = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] quota_volumes = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] rate_limit_burst = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] rate_limit_except_level = CRITICAL {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] rate_limit_interval = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] reinit_driver_count = 3 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] replication_device = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] report_discard_supported = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] report_interval = 120 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] reservation_clean_interval = 86400 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] reservation_expire = 86400 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] reserved_image_namespaces = [] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] reserved_percentage = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] rpc_response_timeout = 120 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] run_external_periodic_tasks = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] scst_target_driver = iscsi {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] scst_target_iqn_name = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] service_down_time = 720 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] shell_completion = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:33 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] snapshot_name_template = snapshot-%s {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] split_loggers = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] state_path = /opt/stack/data/cinder {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] storage_availability_zone = nova {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] storage_protocol = iSCSI {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] syslog_log_facility = LOG_USER {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] target_helper = lioadm {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] target_ip_address = 192.168.122.195 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] target_port = 3260 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] target_protocol = iscsi {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] target_secondary_ip_addresses = [] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] trace_flags = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] transfer_api_class = cinder.transfer.api.API {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] transport_url = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] until_refresh = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] use_chap_auth = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] use_default_quota_class = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] use_journal = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] use_json = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] use_multipath_for_image_xfer = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] use_stderr = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] use_syslog = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] verify_glance_signatures = enabled {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volume_api_class = cinder.volume.api.API {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volume_backend_name = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volume_clear = zero {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volume_clear_ionice = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volume_clear_size = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volume_copy_bps_limit = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volume_dd_blocksize = 1M {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volume_name_template = volume-%s {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volume_service_inithost_offload = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volume_usage_audit_period = month {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] zoning_mode = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_concurrency.disable_process_locking = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.admin_password = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.admin_token = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.admin_user = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.auth_admin_prefix = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.auth_port = 35357 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.auth_protocol = https {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.auth_section = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.auth_type = password {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.auth_uri = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.auth_version = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.cache = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.certfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.delay_auth_decision = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.http_connect_timeout = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83712) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 08:54:34 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.quobyte [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 08:54:34 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.quobyte [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.identity_uri = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.include_service_catalog = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.insecure = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.interface = public {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Running cmd (subprocess): mount.quobyte {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.keyfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_password = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcache_username = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.region_name = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.service_token_roles_required = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.service_type = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.token_cache_time = 300 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.195/identity {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.backend = dogpile.cache.null {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.backend_argument = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.backend_expiration_time = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.config_prefix = cache.oslo {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.debug_cache_backend = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.enable_retry_client = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.enable_socket_keepalive = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.enabled = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.enforce_fips_mode = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.expiration_time = 600 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.hashclient_retry_attempts = 2 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.memcache_dead_retry = 300 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.memcache_pool_maxsize = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.memcache_sasl_enabled = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.password = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.proxies = [] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.redis_db = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.redis_sentinel_service_name = mymaster {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.redis_server = localhost:6379 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.retry_attempts = 2 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.retry_delay = 0.0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.socket_keepalive_count = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.socket_keepalive_idle = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.socket_keepalive_interval = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.socket_timeout = 1.0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.tls_allowed_ciphers = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.tls_cafile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.tls_certfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.tls_enabled = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.tls_keyfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cache.username = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] coordination.backend_url = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.asyncio_connection = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.asyncio_slave_connection = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.backend = sqlalchemy {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.connection = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.connection_debug = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.connection_parameters = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.connection_recycle_time = 3600 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.connection_trace = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.db_inc_retry_interval = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.db_max_retries = 20 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.db_max_retry_interval = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.db_retry_interval = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.max_overflow = 50 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.max_pool_size = 5 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.max_retries = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.mysql_wsrep_sync_wait = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.pool_timeout = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.retry_interval = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.slave_connection = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.sqlite_synchronous = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.synchronous_reader = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] database.use_db_reconnect = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler.connection_string = messaging:// {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler.enabled = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler.es_doc_type = notification {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler.es_scroll_size = 10000 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler.es_scroll_time = 2m {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler.filter_error_trace = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler.hmac_keys = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler.sentinel_service_name = mymaster {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler.socket_timeout = 0.1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler.trace_requests = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler.trace_sqlalchemy = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler_jaeger.process_tags = {} {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler_jaeger.service_name_prefix = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] profiler_otlp.service_name_prefix = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_policy.enforce_new_defaults = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: WARNING oslo_config.cfg [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_policy.enforce_scope = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_policy.policy_default_rule = default {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_policy.policy_file = policy.yaml {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_policy.remote_timeout = 60.0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] privsep_osbrick.group = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] privsep_osbrick.helper_command = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] privsep_osbrick.user = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cinder_sys_admin.group = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cinder_sys_admin.helper_command = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] cinder_sys_admin.user = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] service_user.auth_section = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] service_user.auth_type = password {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] service_user.cafile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack quobyte-client[83716]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] service_user.certfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] service_user.collect_timing = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] service_user.insecure = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] service_user.keyfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] service_user.send_service_user_token = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] service_user.split_loggers = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] service_user.timeout = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack quobyte-client[83716]: Invalid parameters found, error: missing mount point. Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance.auth_section = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance.auth_type = password {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance.certfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance.collect_timing = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance.insecure = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance.keyfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack quobyte-client[83716]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance.region_name = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance.split_loggers = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] glance.timeout = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.backend_availability_zone = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack quobyte-client[83716]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.chap_password = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.chap_username = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.disk_geometry = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.driver_client_cert = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.driver_client_cert_key = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.driver_data_namespace = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.driver_use_ssl = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.enable_unsupported_driver = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.extra_capabilities = {} {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.filter_function = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.goodness_function = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.iscsi_target_flags = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.iscsi_write_cache = on {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.iser_helper = tgtadm {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.iser_ip_address = 192.168.122.195 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.iser_port = 3260 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nas_host = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nas_login = admin {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nas_mount_options = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nas_password = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nas_private_key = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nas_share_path = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nas_ssh_port = 22 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.num_shell_tries = 3 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.nvmet_port_id = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.quobyte_client_cfg = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.quobyte_volume_url = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.replication_device = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.report_discard_supported = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.reserved_percentage = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.scst_target_driver = iscsi {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.scst_target_iqn_name = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.storage_protocol = iSCSI {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.target_helper = tgtadm {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.target_ip_address = 192.168.122.195 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.target_port = 3260 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.target_protocol = iscsi {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.trace_flags = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.unique_fqdn_network = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.use_chap_auth = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.volume_backend_name = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.volume_clear = zero {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.volume_clear_ionice = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.volume_clear_size = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_reports.file_event_handler = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_reports.log_dir = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.backend_availability_zone = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.backend_host = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.chap_password = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.chap_username = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.chiscsi_conf = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.disk_geometry = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.driver_client_cert = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.driver_client_cert_key = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.driver_data_namespace = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.driver_use_ssl = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.extra_capabilities = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.filter_function = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.goodness_function = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack sudo[83722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack sudo[83722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.iscsi_target_flags = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.iscsi_write_cache = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.iser_helper = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.iser_ip_address = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.iser_port = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.iser_target_prefix = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nas_host = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nas_login = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nas_mount_options = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nas_password = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nas_private_key = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nas_share_path = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nas_ssh_port = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.num_shell_tries = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nvmet_ns_id = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.nvmet_port_id = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.replication_device = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.report_discard_supported = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.reserved_percentage = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.scst_target_driver = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.storage_protocol = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.target_helper = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.target_ip_address = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.target_port = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.target_prefix = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.target_protocol = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.trace_flags = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.unique_fqdn_network = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.use_chap_auth = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.volume_clear = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.volume_clear_ionice = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.volume_clear_size = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] QuobyteHD.volumes_dir = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.ssl = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.ssl_version = {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_notifications.driver = [] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_notifications.retry = -1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] oslo_messaging_notifications.transport_url = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] key_manager.fixed_key = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.barbican_api_version = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.barbican_endpoint = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.barbican_endpoint_type = public {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.barbican_region_name = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.cafile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.certfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.collect_timing = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.insecure = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.keyfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.number_of_retries = 60 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.retry_delay = 1 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.send_service_user_token = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.split_loggers = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.timeout = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.verify_ssl = True {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican.verify_ssl_path = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican_service_user.auth_section = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican_service_user.auth_type = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican_service_user.cafile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican_service_user.certfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican_service_user.collect_timing = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican_service_user.insecure = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican_service_user.keyfile = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican_service_user.split_loggers = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] barbican_service_user.timeout = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] vault.approle_role_id = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] vault.approle_secret_id = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] vault.kv_mountpoint = secret {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] vault.kv_path = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] vault.kv_version = 2 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] vault.namespace = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] vault.root_token_id = **** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] vault.ssl_ca_crt_file = None {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] vault.timeout = 60.0 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] vault.use_ssl = False {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:54:34 devstack cinder-volume[83483]: DEBUG oslo_service.backend._eventlet.service [None req-bb2548c8-2b37-4435-8fe4-ff50352ef5bb None None] ******************************************************************************** {{(pid=83483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 08:54:34 devstack sudo[83722]: pam_unix(sudo:session): session closed for user root Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.684s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:54:34 devstack cinder-volume[83712]: INFO cinder.volume.driver [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG cinder.volume.driver [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6515731811523, 'free_capacity_gb': 1775.6515731811523, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83712) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG oslo_db.sqlalchemy.engines [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83712) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writer thread running {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG cinder.db.sqlalchemy.api [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Building query based on filter {{(pid=83712) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83712) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:54:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:54:34 devstack cinder-volume[83712]: INFO cinder.keymgr.migration [None req-d8147ea4-9d03-49b6-865c-d78cb4f5dee6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 08:54:35 devstack sudo[83731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:54:35 devstack sudo[83731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:54:35 devstack sudo[83731]: pam_unix(sudo:session): session closed for user root Apr 29 08:54:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.717s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:54:35 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:54:35 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Driver initialization completed successfully. Apr 29 08:54:35 devstack cinder-volume[83712]: INFO cinder.manager [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Initiating service 3 cleanup Apr 29 08:54:35 devstack cinder-volume[83712]: INFO cinder.manager [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Service 3 cleanup completed. Apr 29 08:54:35 devstack cinder-volume[83712]: DEBUG cinder.service [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Creating RPC server for service cinder-volume {{(pid=83712) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 08:54:35 devstack cinder-volume[83712]: DEBUG cinder.service [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83712) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 08:54:35 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 08:54:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:54:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:54:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:54:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:54:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:54:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:54:35 devstack sudo[83739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:54:35 devstack sudo[83739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:54:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.618s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:54:36 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-0e5d024d-1eb7-44ef-9807-c7b5b5b44274 None None] Driver post RPC initialization completed successfully. Apr 29 08:54:36 devstack sudo[83739]: pam_unix(sudo:session): session closed for user root Apr 29 08:54:43 devstack cinder-volume[83483]: DEBUG dbcounter [-] [83483] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:54:45 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:54:46 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=3 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Flow 'volume_create_manager' (e098eace-1bce-41f9-a074-5c172493ebea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cdb86e-8c20-4412-af2f-5362f694341e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cdb86e-8c20-4412-af2f-5362f694341e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1512129187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21056a1-fc9d-4d82-bd0c-8afe93bd25ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a152fff0b0449099f96d504074d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:55:52Z,use_quota=True,user_id='f1bfa494e0ee4c1e98663cc52d7388e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4ab353-f04b-485d-98bf-21df49c29255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4ab353-f04b-485d-98bf-21df49c29255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ca531f-9487-410e-b529-abd78ac5f04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ca531f-9487-410e-b529-abd78ac5f04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21056a1-fc9d-4d82-bd0c-8afe93bd25ac', 'volume_name': 'volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e394d2-e45b-4e9d-9302-7f2d8ca66133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e394d2-e45b-4e9d-9302-7f2d8ca66133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f288ede4-c5f0-4dfd-b60e-940f8d94e2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:55:52 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Volume a21056a1-fc9d-4d82-bd0c-8afe93bd25ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac', 'volume_size': 1} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1512129187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21056a1-fc9d-4d82-bd0c-8afe93bd25ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a152fff0b0449099f96d504074d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:55:52Z,use_quota=True,user_id='f1bfa494e0ee4c1e98663cc52d7388e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Creating volume a21056a1-fc9d-4d82-bd0c-8afe93bd25ac {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:55:52 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:55:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:55:52 devstack sudo[84826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac 1073741824 Apr 29 08:55:52 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:55:54 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Flow 'volume_create_manager' (02843635-7671-4745-9a78-37a0a4f1c499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26012583-2f00-41ed-8b17-9904ce4ab302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26012583-2f00-41ed-8b17-9904ce4ab302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2120369474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0723524e-9104-4c5b-9efa-49cd4fd8c7c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='840e0fedd7b24e1bb6b55c0940b77767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:55:55Z,use_quota=True,user_id='7ba610f66b8e4992abb6248e46600c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fac23aa-b5ee-4d3a-a7aa-274ec2f8827c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fac23aa-b5ee-4d3a-a7aa-274ec2f8827c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f729858f-aa32-4f30-b664-0e8587281081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f729858f-aa32-4f30-b664-0e8587281081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0723524e-9104-4c5b-9efa-49cd4fd8c7c2', 'volume_name': 'volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1d2298-eca3-4545-b7c3-ef150d4b5bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1d2298-eca3-4545-b7c3-ef150d4b5bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838c7e9c-5966-4683-8795-2336f8bfeb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:55:55 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Volume 0723524e-9104-4c5b-9efa-49cd4fd8c7c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2', 'volume_size': 1} Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:55:55 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac 1073741824" returned: 0 in 2.647s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:55:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:55:55 devstack sudo[85147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac Apr 29 08:55:55 devstack sudo[85147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:55:57 devstack sudo[85147]: pam_unix(sudo:session): session closed for user root Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac" returned: 0 in 1.908s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] <== create_volume: return (4719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.721s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.190s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2120369474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0723524e-9104-4c5b-9efa-49cd4fd8c7c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='840e0fedd7b24e1bb6b55c0940b77767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:55:55Z,use_quota=True,user_id='7ba610f66b8e4992abb6248e46600c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Creating volume 0723524e-9104-4c5b-9efa-49cd4fd8c7c2 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:55:57 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f288ede4-c5f0-4dfd-b60e-940f8d94e2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c80e5b5-4868-43e7-958f-4836d9ddda59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:55:57 devstack sudo[85152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2 1073741824 Apr 29 08:55:57 devstack sudo[85152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:55:57 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Volume volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac (a21056a1-fc9d-4d82-bd0c-8afe93bd25ac): created successfully Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c80e5b5-4868-43e7-958f-4836d9ddda59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:55:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Flow 'volume_create_manager' (e098eace-1bce-41f9-a074-5c172493ebea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:55:57 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-dee7c8bd-227b-4435-9dc2-02cdb4e064db tempest-DeleteServersTestJSON-1611612520 None] Created volume successfully. Apr 29 08:55:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 08:55:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:55:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:55:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:55:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:55:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:55:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:55:59 devstack sudo[85179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:55:59 devstack sudo[85179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:55:59 devstack sudo[85152]: pam_unix(sudo:session): session closed for user root Apr 29 08:55:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2 1073741824" returned: 0 in 2.321s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:55:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:55:59 devstack sudo[85184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2 Apr 29 08:55:59 devstack sudo[85184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:01 devstack sudo[85179]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.875s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:01 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:56:01 devstack sudo[85184]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2" returned: 0 in 2.103s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] <== create_volume: return (4538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:56:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.553s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838c7e9c-5966-4683-8795-2336f8bfeb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4d6aad-b54c-42a8-aa21-39d01c8e0e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:02 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Volume volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2 (0723524e-9104-4c5b-9efa-49cd4fd8c7c2): created successfully Apr 29 08:56:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4d6aad-b54c-42a8-aa21-39d01c8e0e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Flow 'volume_create_manager' (02843635-7671-4745-9a78-37a0a4f1c499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:56:02 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-1d7a53c3-bb61-4942-9334-5cc0013da58e tempest-VolumesAdminNegativeTest-293729463 None] Created volume successfully. Apr 29 08:56:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Acquiring lock "cinder-0723524e-9104-4c5b-9efa-49cd4fd8c7c2-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Lock "cinder-0723524e-9104-4c5b-9efa-49cd4fd8c7c2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Acquiring lock "cinder-quobyte-0723524e-9104-4c5b-9efa-49cd4fd8c7c2" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Lock "cinder-quobyte-0723524e-9104-4c5b-9efa-49cd4fd8c7c2" acquired by "delete_volume" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:04 devstack cinder-volume[83712]: INFO oslo.privsep.daemon [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpz3br82g1/privsep.sock'] Apr 29 08:56:04 devstack sudo[85222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpz3br82g1/privsep.sock Apr 29 08:56:04 devstack sudo[85222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:08 devstack sudo[85222]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:08 devstack cinder-volume[83712]: INFO oslo.privsep.daemon [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Spawned new privsep daemon via rootwrap Apr 29 08:56:08 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Accepted privsep connection to /tmp/tmpz3br82g1/privsep.sock {{(pid=83712) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 29 08:56:08 devstack cinder-volume[83712]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 29 08:56:08 devstack cinder-volume[83712]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 29 08:56:08 devstack cinder-volume[83712]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 29 08:56:08 devstack cinder-volume[83712]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85293 Apr 29 08:56:08 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[995524ce-8a60-430e-8899-bf5d0322fae6]: (2,) {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:56:08 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fb41c5-77d1-4c5c-a29b-eb1d3e390412]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:56:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:08 devstack sudo[85300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2 Apr 29 08:56:08 devstack sudo[85300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:09 devstack sudo[85300]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2" returned: 0 in 1.261s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:09 devstack sudo[85317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2 Apr 29 08:56:09 devstack sudo[85317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:09 devstack cinder-volume[83712]: WARNING py.warnings [req-9fb21eef-7f0d-45ba-a904-47ee990cf0e6 req-0ba26d0d-89ba-4ae9-90b4-d349186c5ad4 tempest-DeleteServersTestJSON-1611612520 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 29 08:56:09 devstack cinder-volume[83712]: .first() Apr 29 08:56:09 devstack cinder-volume[83712]: Apr 29 08:56:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-9fb21eef-7f0d-45ba-a904-47ee990cf0e6 req-0ba26d0d-89ba-4ae9-90b4-d349186c5ad4 tempest-DeleteServersTestJSON-1611612520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-9fb21eef-7f0d-45ba-a904-47ee990cf0e6 req-0ba26d0d-89ba-4ae9-90b4-d349186c5ad4 tempest-DeleteServersTestJSON-1611612520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:10 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e16e3a8-d373-4e4a-8c60-34cc2ca1d24d]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:56:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-9fb21eef-7f0d-45ba-a904-47ee990cf0e6 req-0ba26d0d-89ba-4ae9-90b4-d349186c5ad4 tempest-DeleteServersTestJSON-1611612520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:10 devstack sudo[85321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac Apr 29 08:56:10 devstack sudo[85321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:11 devstack sudo[85317]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0723524e-9104-4c5b-9efa-49cd4fd8c7c2" returned: 0 in 1.460s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Lock "cinder-quobyte-0723524e-9104-4c5b-9efa-49cd4fd8c7c2" released by "delete_volume" :: held 6.419s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:11 devstack sudo[85321]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-9fb21eef-7f0d-45ba-a904-47ee990cf0e6 req-0ba26d0d-89ba-4ae9-90b4-d349186c5ad4 tempest-DeleteServersTestJSON-1611612520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac" returned: 0 in 1.271s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-9fb21eef-7f0d-45ba-a904-47ee990cf0e6 req-0ba26d0d-89ba-4ae9-90b4-d349186c5ad4 tempest-DeleteServersTestJSON-1611612520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.341s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:11 devstack cinder-volume[83712]: WARNING cinder.quota [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:56:11 devstack cinder-volume[83712]: WARNING cinder.quota [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:56:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-9fb21eef-7f0d-45ba-a904-47ee990cf0e6 req-0ba26d0d-89ba-4ae9-90b4-d349186c5ad4 tempest-DeleteServersTestJSON-1611612520 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa', 'name': 'volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c4fcceb-e1f2-4553-bf21-13446c15fde2', 'enforce_multipath': True} {{(pid=83712) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 08:56:11 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Created reservations ['e147e30b-13c8-457d-b073-c34be515c1db', '29f8a6b7-fc8b-4065-9115-cae53dc9cf42', '4db72142-3ec6-4156-a11b-40c13b761953', '1cef7beb-5e1b-4548-9965-188434995a4c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:56:11 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-9fb21eef-7f0d-45ba-a904-47ee990cf0e6 req-0ba26d0d-89ba-4ae9-90b4-d349186c5ad4 tempest-DeleteServersTestJSON-1611612520 None] attachment_update completed successfully. Apr 29 08:56:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:11 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:56:11 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:13 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.523s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:13 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:56:13 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Deleted volume successfully. Apr 29 08:56:13 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8052b260-b96a-4f72-b2c0-6651ba71c5f0 tempest-VolumesAdminNegativeTest-293729463 None] Lock "cinder-0723524e-9104-4c5b-9efa-49cd4fd8c7c2-delete_volume" released by "delete_volume" :: held 8.524s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Flow 'volume_create_manager' (ff29e789-666f-40e1-87b7-65ff69dc019a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04690d0-1f39-4a93-a1a8-640b4effaabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04690d0-1f39-4a93-a1a8-640b4effaabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1697048624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9907de88-fd47-4536-8e29-8600e5ef0e4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a698d534517f426ca8c86b9b9ebd9ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:56:19Z,use_quota=True,user_id='3ac1b85ed6874e5a8b72df2239e7144f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47531e3e-242a-464f-8c9b-dc6dc20dee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47531e3e-242a-464f-8c9b-dc6dc20dee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bdf49c-bfbd-43ea-bb9d-a798e54f18ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bdf49c-bfbd-43ea-bb9d-a798e54f18ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9907de88-fd47-4536-8e29-8600e5ef0e4e', 'volume_name': 'volume-9907de88-fd47-4536-8e29-8600e5ef0e4e', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdad11e-3d6e-41f4-92c8-03799f50b22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdad11e-3d6e-41f4-92c8-03799f50b22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bf1f69-e2d5-4907-9f7f-ff1ca2907095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:19 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Volume 9907de88-fd47-4536-8e29-8600e5ef0e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9907de88-fd47-4536-8e29-8600e5ef0e4e', 'volume_size': 1} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1697048624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9907de88-fd47-4536-8e29-8600e5ef0e4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a698d534517f426ca8c86b9b9ebd9ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:56:19Z,use_quota=True,user_id='3ac1b85ed6874e5a8b72df2239e7144f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Creating volume 9907de88-fd47-4536-8e29-8600e5ef0e4e {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:56:19 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:56:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9907de88-fd47-4536-8e29-8600e5ef0e4e 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:19 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9907de88-fd47-4536-8e29-8600e5ef0e4e 1073741824 Apr 29 08:56:19 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Flow 'volume_create_manager' (6ed442a6-4ced-4172-b442-8ee97955c522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d7212f-60a4-4e80-b508-25e2444e6019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d7212f-60a4-4e80-b508-25e2444e6019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1115187206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b32d5ed-cf7a-4848-b80f-d853a9dddf3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013d518eb406476aafd71a8c47e82d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:56:20Z,use_quota=True,user_id='df57233ca8b4479382f12f1a7efc40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8983ad-7637-453d-83c8-3c157c215874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8983ad-7637-453d-83c8-3c157c215874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acd28b1-58c3-4c5d-bfd7-9130c30963bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acd28b1-58c3-4c5d-bfd7-9130c30963bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b32d5ed-cf7a-4848-b80f-d853a9dddf3d', 'volume_name': 'volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153fba05-435f-4629-8eeb-661d2379c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153fba05-435f-4629-8eeb-661d2379c54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fb88b0-0942-474c-ba64-daa6e85b1670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:20 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Volume 6b32d5ed-cf7a-4848-b80f-d853a9dddf3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d', 'volume_size': 1} Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:20 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9907de88-fd47-4536-8e29-8600e5ef0e4e 1073741824" returned: 0 in 1.043s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9907de88-fd47-4536-8e29-8600e5ef0e4e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:20 devstack sudo[85926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9907de88-fd47-4536-8e29-8600e5ef0e4e Apr 29 08:56:20 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:21 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9907de88-fd47-4536-8e29-8600e5ef0e4e" returned: 0 in 0.619s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.689s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1115187206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b32d5ed-cf7a-4848-b80f-d853a9dddf3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013d518eb406476aafd71a8c47e82d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:56:20Z,use_quota=True,user_id='df57233ca8b4479382f12f1a7efc40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Creating volume 6b32d5ed-cf7a-4848-b80f-d853a9dddf3d {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:56:21 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bf1f69-e2d5-4907-9f7f-ff1ca2907095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9907de88-fd47-4536-8e29-8600e5ef0e4e', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972b9fc9-2106-4888-8842-10e7433ebad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:21 devstack sudo[85930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d 1073741824 Apr 29 08:56:21 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:21 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Volume volume-9907de88-fd47-4536-8e29-8600e5ef0e4e (9907de88-fd47-4536-8e29-8600e5ef0e4e): created successfully Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972b9fc9-2106-4888-8842-10e7433ebad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Flow 'volume_create_manager' (ff29e789-666f-40e1-87b7-65ff69dc019a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:56:21 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-2307c3d2-f5d7-4d82-87ff-159500402a31 tempest-VolumesTestJSON-21029152 None] Created volume successfully. Apr 29 08:56:21 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-960a8fb6-523e-4fcb-88e9-a607d3d0801a req-0f19d25a-caaa-4edb-b80a-b0354c5f4e58 tempest-DeleteServersTestJSON-1611612520 None] Terminate volume connection completed successfully. Apr 29 08:56:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-960a8fb6-523e-4fcb-88e9-a607d3d0801a req-0f19d25a-caaa-4edb-b80a-b0354c5f4e58 tempest-DeleteServersTestJSON-1611612520 None] Deleting attachment 6c4fcceb-e1f2-4553-bf21-13446c15fde2. {{(pid=83712) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 08:56:22 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d 1073741824" returned: 0 in 0.982s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:22 devstack sudo[85937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d Apr 29 08:56:22 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Flow 'volume_create_manager' (b227cec5-7df0-4c65-af3c-090240e4fd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7e8414-2d54-44d2-9fa8-529eb8eed556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7e8414-2d54-44d2-9fa8-529eb8eed556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1755724573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4721bcc1-a21c-43b1-a3bc-16cfbfd98038,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a698d534517f426ca8c86b9b9ebd9ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:56:22Z,use_quota=True,user_id='3ac1b85ed6874e5a8b72df2239e7144f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e388a253-4875-469f-9d01-1171764d048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e388a253-4875-469f-9d01-1171764d048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7322bc1c-00c1-4783-b8f7-7ac678d9f45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7322bc1c-00c1-4783-b8f7-7ac678d9f45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4721bcc1-a21c-43b1-a3bc-16cfbfd98038', 'volume_name': 'volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27d453b-e1f7-4cb5-be09-32024738c0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27d453b-e1f7-4cb5-be09-32024738c0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b4eb68-cdc9-4b96-933e-be1030eed9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:22 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Volume 4721bcc1-a21c-43b1-a3bc-16cfbfd98038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038', 'volume_size': 1} Apr 29 08:56:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:23 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d" returned: 0 in 0.707s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1755724573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4721bcc1-a21c-43b1-a3bc-16cfbfd98038,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a698d534517f426ca8c86b9b9ebd9ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:56:22Z,use_quota=True,user_id='3ac1b85ed6874e5a8b72df2239e7144f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Creating volume 4721bcc1-a21c-43b1-a3bc-16cfbfd98038 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:56:23 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:23 devstack sudo[85941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038 1073741824 Apr 29 08:56:23 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fb88b0-0942-474c-ba64-daa6e85b1670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a8bed7-2668-4e23-86f9-59b2029e787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:23 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Volume volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d (6b32d5ed-cf7a-4848-b80f-d853a9dddf3d): created successfully Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a8bed7-2668-4e23-86f9-59b2029e787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Flow 'volume_create_manager' (6ed442a6-4ced-4172-b442-8ee97955c522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:56:23 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-1bbc975c-9afc-49e7-b6cd-c8f993972247 tempest-ServersNegativeTestJSON-1183427407 None] Created volume successfully. Apr 29 08:56:23 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038 1073741824" returned: 0 in 0.935s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:24 devstack sudo[85949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038 Apr 29 08:56:24 devstack sudo[85949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:24 devstack sudo[85949]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038" returned: 0 in 0.744s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:56:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b4eb68-cdc9-4b96-933e-be1030eed9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ac26b1-e7dd-4bc3-a5bc-8d974c436619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:24 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Volume volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038 (4721bcc1-a21c-43b1-a3bc-16cfbfd98038): created successfully Apr 29 08:56:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ac26b1-e7dd-4bc3-a5bc-8d974c436619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Flow 'volume_create_manager' (b227cec5-7df0-4c65-af3c-090240e4fd1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:56:24 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-cdef0bda-17a8-4ac5-92f7-7d194d0894b2 tempest-VolumesTestJSON-21029152 None] Created volume successfully. Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Flow 'volume_create_manager' (66321943-57d6-466e-bb6e-7171ed6463b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce01f40-4b60-4aa4-a3a8-f46798741173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Acquiring lock "cinder-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce01f40-4b60-4aa4-a3a8-f46798741173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-766685728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cabea25-d968-468f-8f04-4ba29f42e7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013d518eb406476aafd71a8c47e82d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:56:25Z,use_quota=True,user_id='df57233ca8b4479382f12f1a7efc40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d661fa68-f606-4b2c-891b-f010183412a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d661fa68-f606-4b2c-891b-f010183412a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf7ea3e-7d37-44b6-a881-6cb6087330fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf7ea3e-7d37-44b6-a881-6cb6087330fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cabea25-d968-468f-8f04-4ba29f42e7ed', 'volume_name': 'volume-8cabea25-d968-468f-8f04-4ba29f42e7ed', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70cda85-569d-4186-87e7-46de9d8cd8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70cda85-569d-4186-87e7-46de9d8cd8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0df566-c019-4d82-8650-64dda2ce67a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:25 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Volume 8cabea25-d968-468f-8f04-4ba29f42e7ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cabea25-d968-468f-8f04-4ba29f42e7ed', 'volume_size': 1} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-766685728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cabea25-d968-468f-8f04-4ba29f42e7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013d518eb406476aafd71a8c47e82d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:56:25Z,use_quota=True,user_id='df57233ca8b4479382f12f1a7efc40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Creating volume 8cabea25-d968-468f-8f04-4ba29f42e7ed {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:56:25 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8cabea25-d968-468f-8f04-4ba29f42e7ed 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Lock "cinder-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:25 devstack sudo[85953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8cabea25-d968-468f-8f04-4ba29f42e7ed 1073741824 Apr 29 08:56:25 devstack sudo[85953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Acquiring lock "cinder-quobyte-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Lock "cinder-quobyte-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac" acquired by "delete_volume" :: waited 0.018s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6fc82b-c139-415e-8eaa-ff54ca86144e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:56:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:25 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac Apr 29 08:56:25 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Flow 'volume_create_manager' (207ae524-053b-47ce-ae4a-b40c3528c717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442e0bb3-747a-4560-93ae-7163bb530677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442e0bb3-747a-4560-93ae-7163bb530677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-330549483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d1623f-c330-4d65-9287-fe5dc3b2eb41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a698d534517f426ca8c86b9b9ebd9ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:56:26Z,use_quota=True,user_id='3ac1b85ed6874e5a8b72df2239e7144f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ee272a-56d4-47a5-a224-e15d843f6b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ee272a-56d4-47a5-a224-e15d843f6b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028ccc29-b00a-4e56-ae8a-1b7037516f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028ccc29-b00a-4e56-ae8a-1b7037516f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d1623f-c330-4d65-9287-fe5dc3b2eb41', 'volume_name': 'volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff6f2b8-2a77-4d08-8be6-635da24214ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff6f2b8-2a77-4d08-8be6-635da24214ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405c003e-f142-47cc-b730-22effffd3370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:26 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Volume 55d1623f-c330-4d65-9287-fe5dc3b2eb41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41', 'volume_size': 1} Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:26 devstack sudo[85953]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8cabea25-d968-468f-8f04-4ba29f42e7ed 1073741824" returned: 0 in 1.021s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:26 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac" returned: 0 in 0.924s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:26 devstack sudo[85963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac Apr 29 08:56:26 devstack sudo[85963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8cabea25-d968-468f-8f04-4ba29f42e7ed {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:26 devstack sudo[85965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8cabea25-d968-468f-8f04-4ba29f42e7ed Apr 29 08:56:26 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:27 devstack sudo[85963]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac" returned: 0 in 0.673s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Lock "cinder-quobyte-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac" released by "delete_volume" :: held 1.647s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:27 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8cabea25-d968-468f-8f04-4ba29f42e7ed" returned: 0 in 0.661s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-330549483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d1623f-c330-4d65-9287-fe5dc3b2eb41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a698d534517f426ca8c86b9b9ebd9ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:56:26Z,use_quota=True,user_id='3ac1b85ed6874e5a8b72df2239e7144f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Creating volume 55d1623f-c330-4d65-9287-fe5dc3b2eb41 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:56:27 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:27 devstack sudo[85970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41 1073741824 Apr 29 08:56:27 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0df566-c019-4d82-8650-64dda2ce67a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cabea25-d968-468f-8f04-4ba29f42e7ed', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f62fec-dfb6-4075-ab08-af5a8906e65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:27 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Volume volume-8cabea25-d968-468f-8f04-4ba29f42e7ed (8cabea25-d968-468f-8f04-4ba29f42e7ed): created successfully Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f62fec-dfb6-4075-ab08-af5a8906e65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Flow 'volume_create_manager' (66321943-57d6-466e-bb6e-7171ed6463b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:56:27 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f16cad37-72b2-4da6-b0d3-99b458e1fa82 tempest-ServersNegativeTestJSON-1183427407 None] Created volume successfully. Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Created reservations ['1dcc2907-b60a-44a7-96e5-f32f58a68cc8', 'e42029be-50e1-42bf-bd8f-8149ee0c9fcc', 'ae900207-5705-413f-8802-30cf445cff85', '735064ce-41d2-4639-8bf0-d5c7ba1be0a7'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:27 devstack sudo[85972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:56:27 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:28 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.911s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:28 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:56:28 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Deleted volume successfully. Apr 29 08:56:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-85c2db44-7ba1-4a07-a049-463c1a946f04 tempest-DeleteServersTestJSON-1611612520 None] Lock "cinder-a21056a1-fc9d-4d82-bd0c-8afe93bd25ac-delete_volume" released by "delete_volume" :: held 2.880s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:28 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41 1073741824" returned: 0 in 1.198s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:28 devstack sudo[86016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41 Apr 29 08:56:28 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Acquiring lock "cinder-8cabea25-d968-468f-8f04-4ba29f42e7ed-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Lock "cinder-8cabea25-d968-468f-8f04-4ba29f42e7ed-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Acquiring lock "cinder-quobyte-8cabea25-d968-468f-8f04-4ba29f42e7ed" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Lock "cinder-quobyte-8cabea25-d968-468f-8f04-4ba29f42e7ed" acquired by "delete_volume" :: waited 0.029s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:29 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[3484c916-585b-4786-b7e7-8cf1a79fae8b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:56:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8cabea25-d968-468f-8f04-4ba29f42e7ed {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:29 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41" returned: 0 in 0.815s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:29 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:56:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405c003e-f142-47cc-b730-22effffd3370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62f8295-44b9-4035-8997-fd77c49110f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:29 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Volume volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41 (55d1623f-c330-4d65-9287-fe5dc3b2eb41): created successfully Apr 29 08:56:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62f8295-44b9-4035-8997-fd77c49110f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Flow 'volume_create_manager' (207ae524-053b-47ce-ae4a-b40c3528c717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:56:29 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d00594b6-f73a-4bf1-86dd-50c1d192092e tempest-VolumesTestJSON-21029152 None] Created volume successfully. Apr 29 08:56:29 devstack sudo[86020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8cabea25-d968-468f-8f04-4ba29f42e7ed Apr 29 08:56:29 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:30 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8cabea25-d968-468f-8f04-4ba29f42e7ed" returned: 0 in 1.025s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8cabea25-d968-468f-8f04-4ba29f42e7ed {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:30 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8cabea25-d968-468f-8f04-4ba29f42e7ed Apr 29 08:56:30 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Acquiring lock "cinder-55d1623f-c330-4d65-9287-fe5dc3b2eb41-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Lock "cinder-55d1623f-c330-4d65-9287-fe5dc3b2eb41-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Acquiring lock "cinder-quobyte-55d1623f-c330-4d65-9287-fe5dc3b2eb41" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Lock "cinder-quobyte-55d1623f-c330-4d65-9287-fe5dc3b2eb41" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:30 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[481d25ed-3ffc-4fcb-8be1-dba3a80c4401]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:56:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:31 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8cabea25-d968-468f-8f04-4ba29f42e7ed" returned: 0 in 0.805s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Lock "cinder-quobyte-8cabea25-d968-468f-8f04-4ba29f42e7ed" released by "delete_volume" :: held 1.902s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Created reservations ['8490df69-4c05-4950-a368-bd650564e67f', 'd3f7078a-2c89-42f6-b25b-b0ed0f40b27d', 'f8e5c288-d36c-4b88-96d4-318f879eabf8', '7a4772bd-5536-4f4e-ae19-c73a5bc6c3cf'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:56:31 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41 Apr 29 08:56:31 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:31 devstack sudo[86032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:56:31 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Acquiring lock "cinder-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Lock "cinder-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Acquiring lock "cinder-quobyte-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Lock "cinder-quobyte-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5f2535-be1e-43d4-9990-0222f613db02]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:56:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:31 devstack sudo[86034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d Apr 29 08:56:31 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:32 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41" returned: 0 in 1.084s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:32 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41 Apr 29 08:56:32 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:32 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.963s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:32 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:56:32 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Deleted volume successfully. Apr 29 08:56:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-75fbb290-5747-4316-935b-ac7919e3f200 tempest-ServersNegativeTestJSON-1183427407 None] Lock "cinder-8cabea25-d968-468f-8f04-4ba29f42e7ed-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:32 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d" returned: 0 in 1.066s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:32 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d Apr 29 08:56:32 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:32 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-55d1623f-c330-4d65-9287-fe5dc3b2eb41" returned: 0 in 0.872s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Lock "cinder-quobyte-55d1623f-c330-4d65-9287-fe5dc3b2eb41" released by "delete_volume" :: held 2.034s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Created reservations ['d1c06242-2992-4378-bf79-62da15e3dfe6', 'f534dd0c-e298-4355-b6a8-fd76c41d596c', 'ec5a99c5-c6a5-4e8f-a12c-392bec5d5fab', '4ecc621e-53e0-4222-bcd3-1df21a791d88'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:33 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:56:33 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:33 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d" returned: 0 in 0.820s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Lock "cinder-quobyte-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d" released by "delete_volume" :: held 1.973s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Created reservations ['9eb9cae4-8610-4f2e-b5bd-5e20611b6bf2', '4bb90e20-aa5d-4ca9-8d12-876db637858d', '24736aea-b7f9-4bbc-b076-9d864e3a08e6', '789eaa62-04aa-43c3-9eed-9500530f8725'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:33 devstack sudo[86054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:56:33 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:34 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.915s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:34 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:56:34 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Deleted volume successfully. Apr 29 08:56:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d8e9405c-e708-424f-abb3-ccd9eb48f52d tempest-VolumesTestJSON-21029152 None] Lock "cinder-55d1623f-c330-4d65-9287-fe5dc3b2eb41-delete_volume" released by "delete_volume" :: held 3.327s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Acquiring lock "cinder-4721bcc1-a21c-43b1-a3bc-16cfbfd98038-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Lock "cinder-4721bcc1-a21c-43b1-a3bc-16cfbfd98038-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Acquiring lock "cinder-quobyte-4721bcc1-a21c-43b1-a3bc-16cfbfd98038" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Lock "cinder-quobyte-4721bcc1-a21c-43b1-a3bc-16cfbfd98038" acquired by "delete_volume" :: waited 0.038s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:34 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d3e9ce-9624-4139-afc5-a2549b90b174]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:56:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:34 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.117s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:34 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:56:34 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Deleted volume successfully. Apr 29 08:56:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-3a64def8-d67a-4319-86eb-a9a77f6e4f2e tempest-ServersNegativeTestJSON-1183427407 None] Lock "cinder-6b32d5ed-cf7a-4848-b80f-d853a9dddf3d-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:34 devstack sudo[86059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038 Apr 29 08:56:34 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:35 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038" returned: 0 in 1.118s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:35 devstack sudo[86106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038 Apr 29 08:56:35 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:36 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4721bcc1-a21c-43b1-a3bc-16cfbfd98038" returned: 0 in 0.901s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Lock "cinder-quobyte-4721bcc1-a21c-43b1-a3bc-16cfbfd98038" released by "delete_volume" :: held 2.082s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:36 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Created reservations ['cec914a3-16b3-425e-b3be-5671e466a916', 'a375bd65-3471-41b2-aa59-7fe8b2829f0f', '4e5cd6e9-43bc-4f9c-ac7e-e54c676b3adf', '22cc14f1-ad19-4b27-98cb-bef1554399ef'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:56:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:36 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:56:36 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:37 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.753s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:37 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:56:37 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Deleted volume successfully. Apr 29 08:56:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d41e66af-516b-4a77-97cc-fc4c25d8d045 tempest-VolumesTestJSON-21029152 None] Lock "cinder-4721bcc1-a21c-43b1-a3bc-16cfbfd98038-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Acquiring lock "cinder-9907de88-fd47-4536-8e29-8600e5ef0e4e-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Lock "cinder-9907de88-fd47-4536-8e29-8600e5ef0e4e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Acquiring lock "cinder-quobyte-9907de88-fd47-4536-8e29-8600e5ef0e4e" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:56:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Lock "cinder-quobyte-9907de88-fd47-4536-8e29-8600e5ef0e4e" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:56:38 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b5435b-df46-4f61-bb53-7a88d38f1359]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:56:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9907de88-fd47-4536-8e29-8600e5ef0e4e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:38 devstack sudo[86116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9907de88-fd47-4536-8e29-8600e5ef0e4e Apr 29 08:56:38 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:39 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9907de88-fd47-4536-8e29-8600e5ef0e4e" returned: 0 in 0.840s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9907de88-fd47-4536-8e29-8600e5ef0e4e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:39 devstack sudo[86122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9907de88-fd47-4536-8e29-8600e5ef0e4e Apr 29 08:56:39 devstack sudo[86122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:39 devstack sudo[86122]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9907de88-fd47-4536-8e29-8600e5ef0e4e" returned: 0 in 0.714s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Lock "cinder-quobyte-9907de88-fd47-4536-8e29-8600e5ef0e4e" released by "delete_volume" :: held 1.609s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:39 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Created reservations ['3ea3bd2c-b886-4c8a-bdaa-84e8e755f195', '40fa5ca8-d429-416b-8a87-c66796595669', 'd8192294-3197-4113-9fea-0e986f84846f', '1a212cdc-732b-4a53-bee1-ebe14caa8eb5'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:56:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:39 devstack sudo[86125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:56:39 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:40 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.889s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:40 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:56:40 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Deleted volume successfully. Apr 29 08:56:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cd10c9a4-897a-406f-b777-fc43de3c1b71 tempest-VolumesTestJSON-21029152 None] Lock "cinder-9907de88-fd47-4536-8e29-8600e5ef0e4e-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:56:49 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:UPDATE=76,cinder:SELECT=53,cinder:DELETE=5,cinder:INSERT=20 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:56:50 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=59,cinder:UPDATE=82,cinder:INSERT=15,cinder:DELETE=9 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:56:58 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ca0be466-c42a-4411-968d-3c6d2974c20b tempest-GroupsTest-1812698103 None] Group tempest-Group1-622913790: creating Apr 29 08:56:58 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ca0be466-c42a-4411-968d-3c6d2974c20b tempest-GroupsTest-1812698103 None] Group tempest-Group1-622913790: created successfully Apr 29 08:56:58 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ca0be466-c42a-4411-968d-3c6d2974c20b tempest-GroupsTest-1812698103 None] Create group completed successfully. Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Flow 'volume_create_manager' (f226450f-d428-42e1-bf54-50084672fadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937b4e2e-e039-4ffe-9a5c-5f7ffff31939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937b4e2e-e039-4ffe-9a5c-5f7ffff31939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1026749489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c8d2c4-93c0-4453-a370-b7e5d8c578cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec43ae1344141a3bf79f2dc3eb10b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:56:58Z,use_quota=True,user_id='16c0ac58cfc5430e8132eb4370a0b529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010f6aac-7780-497e-b4bf-572eb79054b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010f6aac-7780-497e-b4bf-572eb79054b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76af828-4e5b-4443-acb4-bb92788e6e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76af828-4e5b-4443-acb4-bb92788e6e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c8d2c4-93c0-4453-a370-b7e5d8c578cd', 'volume_name': 'volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baffbfb2-1894-48e0-957d-388434945c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baffbfb2-1894-48e0-957d-388434945c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7968a366-f65f-43d4-a971-b6cdf9fdb707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:58 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Volume 90c8d2c4-93c0-4453-a370-b7e5d8c578cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd', 'volume_size': 1} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1026749489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c8d2c4-93c0-4453-a370-b7e5d8c578cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec43ae1344141a3bf79f2dc3eb10b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:56:58Z,use_quota=True,user_id='16c0ac58cfc5430e8132eb4370a0b529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Creating volume 90c8d2c4-93c0-4453-a370-b7e5d8c578cd {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:56:58 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:56:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:58 devstack sudo[86162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd 1073741824 Apr 29 08:56:58 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:59 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd 1073741824" returned: 0 in 0.829s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:59 devstack sudo[86170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd Apr 29 08:56:59 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-4d4ad0ca-7fa8-4b89-8b9d-ef4ec27a8845 tempest-GroupsTest-1812698103 None] Group tempest-Group2-398963291: creating Apr 29 08:56:59 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:59 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-4d4ad0ca-7fa8-4b89-8b9d-ef4ec27a8845 tempest-GroupsTest-1812698103 None] Group tempest-Group2-398963291: created successfully Apr 29 08:56:59 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-4d4ad0ca-7fa8-4b89-8b9d-ef4ec27a8845 tempest-GroupsTest-1812698103 None] Create group completed successfully. Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:56:59 devstack sudo[86172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:56:59 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:56:59 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd" returned: 0 in 0.649s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7968a366-f65f-43d4-a971-b6cdf9fdb707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bd84d0-0283-4730-80d3-f4027a0e25f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:56:59 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Volume volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd (90c8d2c4-93c0-4453-a370-b7e5d8c578cd): created successfully Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bd84d0-0283-4730-80d3-f4027a0e25f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:56:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Flow 'volume_create_manager' (f226450f-d428-42e1-bf54-50084672fadc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:00 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-a1375fce-ec92-42cc-a79e-5f91702ad15f req-1ac8acc3-1ce8-4010-858b-3a93fc5c73f5 tempest-VolumesSnapshotsTestJSON-1191733395 None] Created volume successfully. Apr 29 08:57:00 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.756s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Flow 'volume_create_manager' (a0022468-5f4f-404a-8ec4-6bab2417d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750f2fd3-1162-474f-8326-3c08c56d1eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750f2fd3-1162-474f-8326-3c08c56d1eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1122313898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11197ba6-b8df-403a-81bc-13e9a77033b7,host='devstack@QuobyteHD#QuobyteHD',id=2183bf39-7ae6-4a68-848b-0252732bcc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe202366a3f64000bbf98b355526d71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:01Z,use_quota=True,user_id='4470054b95b4417ca412316c4bedeb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0d76981-88c3-44fd-ae81-1a51b60bd199),volume_type_id=e0d76981-88c3-44fd-ae81-1a51b60bd199)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09da7594-6168-492d-b169-de2ebc6956dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09da7594-6168-492d-b169-de2ebc6956dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1006ed2-cdee-46e7-93e8-8129b045fb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1006ed2-cdee-46e7-93e8-8129b045fb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2183bf39-7ae6-4a68-848b-0252732bcc37', 'volume_name': 'volume-2183bf39-7ae6-4a68-848b-0252732bcc37', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c370e12-4994-44bd-99c8-a62e633274cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c370e12-4994-44bd-99c8-a62e633274cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4027e1-338b-4515-9f7b-f1729f1158af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:01 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Volume 2183bf39-7ae6-4a68-848b-0252732bcc37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2183bf39-7ae6-4a68-848b-0252732bcc37', 'volume_size': 1} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11197ba6-b8df-403a-81bc-13e9a77033b7,created_at=2026-04-29T06:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1122313898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11197ba6-b8df-403a-81bc-13e9a77033b7,host='devstack@QuobyteHD#QuobyteHD',id=2183bf39-7ae6-4a68-848b-0252732bcc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe202366a3f64000bbf98b355526d71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:01Z,use_quota=True,user_id='4470054b95b4417ca412316c4bedeb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0d76981-88c3-44fd-ae81-1a51b60bd199),volume_type_id=e0d76981-88c3-44fd-ae81-1a51b60bd199)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Creating volume 2183bf39-7ae6-4a68-848b-0252732bcc37 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:57:01 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2183bf39-7ae6-4a68-848b-0252732bcc37 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:01 devstack sudo[86177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2183bf39-7ae6-4a68-848b-0252732bcc37 1073741824 Apr 29 08:57:01 devstack sudo[86177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:02 devstack sudo[86177]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2183bf39-7ae6-4a68-848b-0252732bcc37 1073741824" returned: 0 in 1.137s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2183bf39-7ae6-4a68-848b-0252732bcc37 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:02 devstack sudo[86199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2183bf39-7ae6-4a68-848b-0252732bcc37 Apr 29 08:57:02 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:03 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2183bf39-7ae6-4a68-848b-0252732bcc37" returned: 0 in 0.676s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:57:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.805s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4027e1-338b-4515-9f7b-f1729f1158af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2183bf39-7ae6-4a68-848b-0252732bcc37', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7976361-51bf-4d68-af85-54cbfd42be27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] Creating offline snapshot f5fd73b4-3aad-4244-a044-ecd79d15c3d6 of volume 90c8d2c4-93c0-4453-a370-b7e5d8c578cd {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 08:57:03 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Volume volume-2183bf39-7ae6-4a68-848b-0252732bcc37 (2183bf39-7ae6-4a68-848b-0252732bcc37): created successfully Apr 29 08:57:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7976361-51bf-4d68-af85-54cbfd42be27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Flow 'volume_create_manager' (a0022468-5f4f-404a-8ec4-6bab2417d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:03 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[0944b12d-ba0f-4f62-a4c0-ea2351d8bd85]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:03 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b5c08602-768d-4adc-9f30-1c0df4e58f6e tempest-GroupsTest-1812698103 None] Created volume successfully. Apr 29 08:57:03 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd Apr 29 08:57:03 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Acquiring lock "cinder-quobyte-2183bf39-7ae6-4a68-848b-0252732bcc37" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:04 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd" returned: 0 in 1.036s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Lock "cinder-quobyte-2183bf39-7ae6-4a68-848b-0252732bcc37" acquired by "delete_volume" :: waited 0.048s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:04 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 1G Apr 29 08:57:04 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:04 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6fcc7a-431c-4e7d-b576-5e97175013dc]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2183bf39-7ae6-4a68-848b-0252732bcc37 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:04 devstack sudo[86223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2183bf39-7ae6-4a68-848b-0252732bcc37 Apr 29 08:57:04 devstack sudo[86223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:05 devstack sudo[86223]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2183bf39-7ae6-4a68-848b-0252732bcc37" returned: 0 in 1.148s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2183bf39-7ae6-4a68-848b-0252732bcc37 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:05 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 1G" returned: 0 in 1.258s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:05 devstack sudo[86238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2183bf39-7ae6-4a68-848b-0252732bcc37 Apr 29 08:57:05 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:05 devstack sudo[86240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 Apr 29 08:57:05 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:06 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2183bf39-7ae6-4a68-848b-0252732bcc37" returned: 0 in 0.875s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:06 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6" returned: 0 in 0.864s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:06 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 is being set with open permissions: ugo+rw Apr 29 08:57:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Lock "cinder-quobyte-2183bf39-7ae6-4a68-848b-0252732bcc37" released by "delete_volume" :: held 2.113s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:57:06 devstack sudo[86263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 Apr 29 08:57:06 devstack sudo[86263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:06 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Created reservations ['efab9872-7e4b-4c1d-b9e4-e7c2f13d5a4d'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:57:06 devstack cinder-volume[83712]: WARNING cinder.quota [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-809384948 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-809384948, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:57:06 devstack cinder-volume[83712]: WARNING cinder.quota [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-809384948 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-809384948, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:57:06 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Created reservations ['c3d7e77c-33e6-46ba-8956-5022e56a2c65', 'fe12f102-60b8-43ee-83a7-c59952ef2dcd', '3b98a468-ded9-44fb-ac9e-81377ab4ac73', 'd483c4e8-e38e-4774-970a-6cb22f9b1a97'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:57:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:06 devstack sudo[86272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:57:06 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:07 devstack sudo[86263]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6" returned: 0 in 0.791s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:07 devstack sudo[86275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.info Apr 29 08:57:07 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:07 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.668s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:07 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:57:07 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b18115e5-5513-4551-a5af-f1580886bc11 tempest-GroupsTest-1812698103 None] Delete group completed successfully. Apr 29 08:57:07 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-d9b9224c-99d6-4322-89b2-dd9eca43c781 tempest-GroupsTest-1812698103 None] Created reservations ['588d3d12-ac28-4e71-b298-f6e871f862ba'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:57:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d9b9224c-99d6-4322-89b2-dd9eca43c781 tempest-GroupsTest-1812698103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d9b9224c-99d6-4322-89b2-dd9eca43c781 tempest-GroupsTest-1812698103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:08 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d9b9224c-99d6-4322-89b2-dd9eca43c781 tempest-GroupsTest-1812698103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:08 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d9b9224c-99d6-4322-89b2-dd9eca43c781 tempest-GroupsTest-1812698103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d9b9224c-99d6-4322-89b2-dd9eca43c781 tempest-GroupsTest-1812698103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d9b9224c-99d6-4322-89b2-dd9eca43c781 tempest-GroupsTest-1812698103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:08 devstack sudo[86332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:57:08 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:08 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.info" returned: 0 in 1.241s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:08 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.info is being set with open permissions: ugo+rw Apr 29 08:57:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:08 devstack sudo[86349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.info Apr 29 08:57:08 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:09 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d9b9224c-99d6-4322-89b2-dd9eca43c781 tempest-GroupsTest-1812698103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.207s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:09 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-d9b9224c-99d6-4322-89b2-dd9eca43c781 tempest-GroupsTest-1812698103 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:57:09 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d9b9224c-99d6-4322-89b2-dd9eca43c781 tempest-GroupsTest-1812698103 None] Delete group completed successfully. Apr 29 08:57:09 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.info" returned: 0 in 0.938s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.285s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:09 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-6dbb1834-7415-45ea-89ff-a1e839ab9cdc req-985885c7-8c8d-4cc7-9e07-9edd30e59114 tempest-VolumesSnapshotsTestJSON-1191733395 None] Create snapshot completed successfully Apr 29 08:57:09 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-0620914b-8ebc-46e0-ad80-30cd1174d949 tempest-GroupsTest-1812698103 None] Group tempest-GroupsTest-Group-1829965912: creating Apr 29 08:57:09 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-0620914b-8ebc-46e0-ad80-30cd1174d949 tempest-GroupsTest-1812698103 None] Group tempest-GroupsTest-Group-1829965912: created successfully Apr 29 08:57:09 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-0620914b-8ebc-46e0-ad80-30cd1174d949 tempest-GroupsTest-1812698103 None] Create group completed successfully. Apr 29 08:57:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Acquiring lock "cinder-f5fd73b4-3aad-4244-a044-ecd79d15c3d6-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "cinder-f5fd73b4-3aad-4244-a044-ecd79d15c3d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Acquiring lock "cinder-quobyte-90c8d2c4-93c0-4453-a370-b7e5d8c578cd" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "cinder-quobyte-90c8d2c4-93c0-4453-a370-b7e5d8c578cd" acquired by "delete_snapshot" :: waited 0.039s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Acquiring lock "cinder-quobyte-f5fd73b4-3aad-4244-a044-ecd79d15c3d6" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "cinder-quobyte-f5fd73b4-3aad-4244-a044-ecd79d15c3d6" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Deleting offline snapshot f5fd73b4-3aad-4244-a044-ecd79d15c3d6 of volume 90c8d2c4-93c0-4453-a370-b7e5d8c578cd {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 08:57:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] snapshot_file for this snap is: volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 08:57:10 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cb97b3-fad4-47ca-8113-3cb7344604a4]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:11 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 Apr 29 08:57:11 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Flow 'volume_create_manager' (c82ae005-98ca-4f40-b1a3-2aacc4bac12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb00f1bf-1050-408b-8492-6866d6a31e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb00f1bf-1050-408b-8492-6866d6a31e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1161538935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25d866c1-fab5-4dbb-b83c-d3fb0a852093,host='devstack@QuobyteHD#QuobyteHD',id=b060d3ee-8bec-4c07-ae4a-dde2e9e24105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe202366a3f64000bbf98b355526d71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:12Z,use_quota=True,user_id='4470054b95b4417ca412316c4bedeb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(495f3a5f-f06e-4f1d-b4a4-906ece06c42c),volume_type_id=495f3a5f-f06e-4f1d-b4a4-906ece06c42c)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be6d7ac-89ed-49bc-8644-112ab600688e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be6d7ac-89ed-49bc-8644-112ab600688e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffcf6a5-efb5-4eef-a407-2e9702afc221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffcf6a5-efb5-4eef-a407-2e9702afc221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b060d3ee-8bec-4c07-ae4a-dde2e9e24105', 'volume_name': 'volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d7983e-8918-4860-b253-ef4a7b2ab4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d7983e-8918-4860-b253-ef4a7b2ab4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c6fad6-90bb-46ce-9fb2-290e55d305bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:12 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Volume b060d3ee-8bec-4c07-ae4a-dde2e9e24105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105', 'volume_size': 1} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25d866c1-fab5-4dbb-b83c-d3fb0a852093,created_at=2026-04-29T06:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1161538935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25d866c1-fab5-4dbb-b83c-d3fb0a852093,host='devstack@QuobyteHD#QuobyteHD',id=b060d3ee-8bec-4c07-ae4a-dde2e9e24105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe202366a3f64000bbf98b355526d71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:12Z,use_quota=True,user_id='4470054b95b4417ca412316c4bedeb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(495f3a5f-f06e-4f1d-b4a4-906ece06c42c),volume_type_id=495f3a5f-f06e-4f1d-b4a4-906ece06c42c)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Creating volume b060d3ee-8bec-4c07-ae4a-dde2e9e24105 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:57:12 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:12 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105 1073741824 Apr 29 08:57:12 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:12 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6" returned: 0 in 2.108s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 08:57:13 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[80672f9f-2e60-4347-adea-2169f4cf8a2b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:13 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd Apr 29 08:57:13 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:14 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd" returned: 0 in 1.934s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:15 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105 1073741824" returned: 0 in 2.306s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:15 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 Apr 29 08:57:15 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:15 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105 Apr 29 08:57:15 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:16 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6" returned: 0 in 1.594s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:16 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6 Apr 29 08:57:16 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:16 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105" returned: 0 in 1.649s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:16 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] <== create_volume: return (4055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:57:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.059s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c6fad6-90bb-46ce-9fb2-290e55d305bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5682ca54-ce04-4630-970c-3ba1eefe0b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:16 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Volume volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105 (b060d3ee-8bec-4c07-ae4a-dde2e9e24105): created successfully Apr 29 08:57:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5682ca54-ce04-4630-970c-3ba1eefe0b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Flow 'volume_create_manager' (c82ae005-98ca-4f40-b1a3-2aacc4bac12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:16 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a7ef4bdf-f40a-4916-b376-69850eb07fea tempest-GroupsTest-1812698103 None] Created volume successfully. Apr 29 08:57:17 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd.f5fd73b4-3aad-4244-a044-ecd79d15c3d6" returned: 0 in 1.140s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "cinder-quobyte-f5fd73b4-3aad-4244-a044-ecd79d15c3d6" released by "_delete_snapshot" :: held 7.097s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:57:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "cinder-quobyte-90c8d2c4-93c0-4453-a370-b7e5d8c578cd" released by "delete_snapshot" :: held 7.164s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:57:17 devstack cinder-volume[83712]: WARNING cinder.quota [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.quota [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Created reservations ['6354cd3a-d16b-4058-bb5a-8de9e6ebc7d4', 'ddd28fb9-e68c-4ad9-8dbd-a391bad455f1', '8af54fd3-ba8a-4296-a784-5ede7d020cbe', 'f2828e39-d894-4b0c-9985-d4014f83006f'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Flow 'volume_create_manager' (ae0747c3-6119-49de-9882-f3f28ab5c69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6013271-86dc-48c8-95af-44a08f101195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6013271-86dc-48c8-95af-44a08f101195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-284675823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25d866c1-fab5-4dbb-b83c-d3fb0a852093,host='devstack@QuobyteHD#QuobyteHD',id=23cda630-b26e-42a9-9f73-de99bf48b2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe202366a3f64000bbf98b355526d71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:18Z,use_quota=True,user_id='4470054b95b4417ca412316c4bedeb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(495f3a5f-f06e-4f1d-b4a4-906ece06c42c),volume_type_id=495f3a5f-f06e-4f1d-b4a4-906ece06c42c)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f588b4-ccad-47e2-acd1-7d11ee9e7afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f588b4-ccad-47e2-acd1-7d11ee9e7afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d340c7-130c-490e-bdc6-4ac405fbc132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d340c7-130c-490e-bdc6-4ac405fbc132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23cda630-b26e-42a9-9f73-de99bf48b2e2', 'volume_name': 'volume-23cda630-b26e-42a9-9f73-de99bf48b2e2', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974ff4ee-af33-4599-91ee-912a54834c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974ff4ee-af33-4599-91ee-912a54834c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24589eac-8f89-42be-878a-3bc5df5e228f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:18 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Volume 23cda630-b26e-42a9-9f73-de99bf48b2e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23cda630-b26e-42a9-9f73-de99bf48b2e2', 'volume_size': 1} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25d866c1-fab5-4dbb-b83c-d3fb0a852093,created_at=2026-04-29T06:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-284675823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25d866c1-fab5-4dbb-b83c-d3fb0a852093,host='devstack@QuobyteHD#QuobyteHD',id=23cda630-b26e-42a9-9f73-de99bf48b2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe202366a3f64000bbf98b355526d71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:18Z,use_quota=True,user_id='4470054b95b4417ca412316c4bedeb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(495f3a5f-f06e-4f1d-b4a4-906ece06c42c),volume_type_id=495f3a5f-f06e-4f1d-b4a4-906ece06c42c)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Creating volume 23cda630-b26e-42a9-9f73-de99bf48b2e2 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:57:18 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23cda630-b26e-42a9-9f73-de99bf48b2e2 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:18 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23cda630-b26e-42a9-9f73-de99bf48b2e2 1073741824 Apr 29 08:57:18 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Acquiring lock "cinder-90c8d2c4-93c0-4453-a370-b7e5d8c578cd-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "cinder-90c8d2c4-93c0-4453-a370-b7e5d8c578cd-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:18 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Delete snapshot completed successfully. Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-515e5628-8b6b-483c-8eba-a2a7eb737519 req-57f26055-b881-4fbb-99d0-cd70ef7b97be tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "cinder-f5fd73b4-3aad-4244-a044-ecd79d15c3d6-delete_snapshot" released by "delete_snapshot" :: held 7.935s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Acquiring lock "cinder-quobyte-90c8d2c4-93c0-4453-a370-b7e5d8c578cd" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "cinder-quobyte-90c8d2c4-93c0-4453-a370-b7e5d8c578cd" acquired by "delete_volume" :: waited 0.069s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b98177-31e9-499f-a150-911778b9dd2c]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:19 devstack sudo[86508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd Apr 29 08:57:19 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:20 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23cda630-b26e-42a9-9f73-de99bf48b2e2 1073741824" returned: 0 in 2.106s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23cda630-b26e-42a9-9f73-de99bf48b2e2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:20 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23cda630-b26e-42a9-9f73-de99bf48b2e2 Apr 29 08:57:20 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:20 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd" returned: 0 in 1.860s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:20 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd Apr 29 08:57:20 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:22 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23cda630-b26e-42a9-9f73-de99bf48b2e2" returned: 0 in 1.949s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] <== create_volume: return (4125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.131s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24589eac-8f89-42be-878a-3bc5df5e228f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23cda630-b26e-42a9-9f73-de99bf48b2e2', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c472616-fc4c-48f6-9edc-4188967987f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:22 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-90c8d2c4-93c0-4453-a370-b7e5d8c578cd" returned: 0 in 1.803s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:22 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Volume volume-23cda630-b26e-42a9-9f73-de99bf48b2e2 (23cda630-b26e-42a9-9f73-de99bf48b2e2): created successfully Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c472616-fc4c-48f6-9edc-4188967987f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Flow 'volume_create_manager' (ae0747c3-6119-49de-9882-f3f28ab5c69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "cinder-quobyte-90c8d2c4-93c0-4453-a370-b7e5d8c578cd" released by "delete_volume" :: held 3.951s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:57:22 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-2699efa6-0a73-458d-8ff7-4fb589f98bc6 tempest-GroupsTest-1812698103 None] Created volume successfully. Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG cinder.quota [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Created reservations ['8ca6533f-fa81-4eea-abc3-36101f68aea0', 'fabda5e5-bf57-423d-8286-192a6b4a5ff6', 'a80ba3aa-5375-4c27-bbdb-32f062c8ca03', '6ca4879a-3052-456e-abd0-ab3bafed1895'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:22 devstack sudo[86547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:57:22 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:23 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e94ce9c9-2a69-4393-8646-6222c134274e tempest-GroupsTest-1812698103 None] Update group completed successfully. Apr 29 08:57:25 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 2.156s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:25 devstack cinder-volume[83712]: DEBUG cinder.manager [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:57:25 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Deleted volume successfully. Apr 29 08:57:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-4a41c9fa-7d9b-4b86-a9ce-ec1b79c2f9a5 req-c0603aeb-2a67-4270-9f2b-9e20d584b0b1 tempest-VolumesSnapshotsTestJSON-1191733395 None] Lock "cinder-90c8d2c4-93c0-4453-a370-b7e5d8c578cd-delete_volume" released by "delete_volume" :: held 6.678s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:57:25 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ecdcb674-ac12-468c-8159-fdcf22a1303c tempest-GroupsTest-1812698103 None] Update group completed successfully. Apr 29 08:57:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Acquiring lock "cinder-quobyte-23cda630-b26e-42a9-9f73-de99bf48b2e2" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Lock "cinder-quobyte-23cda630-b26e-42a9-9f73-de99bf48b2e2" acquired by "delete_volume" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:27 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49024b1-b2eb-44c5-be52-e61616ba26eb]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23cda630-b26e-42a9-9f73-de99bf48b2e2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:27 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23cda630-b26e-42a9-9f73-de99bf48b2e2 Apr 29 08:57:27 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:28 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23cda630-b26e-42a9-9f73-de99bf48b2e2" returned: 0 in 0.884s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23cda630-b26e-42a9-9f73-de99bf48b2e2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:28 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23cda630-b26e-42a9-9f73-de99bf48b2e2 Apr 29 08:57:28 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:29 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23cda630-b26e-42a9-9f73-de99bf48b2e2" returned: 0 in 1.069s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Lock "cinder-quobyte-23cda630-b26e-42a9-9f73-de99bf48b2e2" released by "delete_volume" :: held 2.004s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:57:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Acquiring lock "cinder-quobyte-b060d3ee-8bec-4c07-ae4a-dde2e9e24105" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Lock "cinder-quobyte-b060d3ee-8bec-4c07-ae4a-dde2e9e24105" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:29 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[6553edf4-4b64-4b9b-94ee-056ccf5fe61d]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:29 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105 Apr 29 08:57:29 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:30 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105" returned: 0 in 1.261s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:30 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105 Apr 29 08:57:30 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:31 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b060d3ee-8bec-4c07-ae4a-dde2e9e24105" returned: 0 in 0.963s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Lock "cinder-quobyte-b060d3ee-8bec-4c07-ae4a-dde2e9e24105" released by "delete_volume" :: held 2.286s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:57:31 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Created reservations ['7f479566-e3c2-4fa0-a332-3dc3f50bef8f'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:57:31 devstack cinder-volume[83712]: WARNING cinder.quota [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-806805074 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-806805074, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:57:31 devstack cinder-volume[83712]: WARNING cinder.quota [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-806805074 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-806805074, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:57:31 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Created reservations ['1004ab8a-ea5c-479c-9ba5-75f85275e609', '6ad17ce9-366f-4980-b4cc-46d50a1862ef', '2e412216-7627-4ee7-9310-6bcf8482a1a4', '51ef7bcd-e203-4171-99b1-aee71800134e'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:57:31 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Created reservations ['dd952b7c-c470-46b5-8cc5-3d9b35557c74', '66d76ca6-b585-4df9-861b-e69ac5cbc137', '9087e0fb-5602-4d1f-acdf-cf9b03207fed', 'cbd6dd2d-2989-474a-b8db-54f11209febd'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:57:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:32 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:32 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:32 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:57:32 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:33 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.615s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:33 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:57:33 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-5febc0c6-da69-4e2f-937f-1c0563dadd9a tempest-GroupsTest-1812698103 None] Delete group completed successfully. Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Flow 'volume_create_manager' (1f16dea2-d7d7-4a7d-807a-f7f646191759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba56fc7-48f9-4dbe-a82e-30a4498e1144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba56fc7-48f9-4dbe-a82e-30a4498e1144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-150537019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857fb49a-3a8b-4af4-a0af-4642e3a3aa85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6b6b9077d243bca351b1a1d820ac07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:35Z,use_quota=True,user_id='4ee5c9a1fd2845e3abf7f989007c40b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d527426-f6aa-4404-a1c0-386003164b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d527426-f6aa-4404-a1c0-386003164b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7450a4c5-134e-4158-8b90-54d99246dc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7450a4c5-134e-4158-8b90-54d99246dc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '857fb49a-3a8b-4af4-a0af-4642e3a3aa85', 'volume_name': 'volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4ef70b-1744-4c80-b0e5-db9a0134693c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4ef70b-1744-4c80-b0e5-db9a0134693c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55263fd-375a-43f7-aa1d-a414c914356e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:34 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Volume 857fb49a-3a8b-4af4-a0af-4642e3a3aa85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85', 'volume_size': 1} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-150537019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857fb49a-3a8b-4af4-a0af-4642e3a3aa85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6b6b9077d243bca351b1a1d820ac07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:35Z,use_quota=True,user_id='4ee5c9a1fd2845e3abf7f989007c40b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Creating volume 857fb49a-3a8b-4af4-a0af-4642e3a3aa85 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:57:34 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:57:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:34 devstack sudo[86758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85 1073741824 Apr 29 08:57:34 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:36 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85 1073741824" returned: 0 in 1.214s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:36 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85 Apr 29 08:57:36 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:37 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85" returned: 0 in 1.024s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] <== create_volume: return (2333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:57:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.341s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55263fd-375a-43f7-aa1d-a414c914356e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034a8779-cb0f-4a27-be3b-8625d4a4360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:37 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Volume volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85 (857fb49a-3a8b-4af4-a0af-4642e3a3aa85): created successfully Apr 29 08:57:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034a8779-cb0f-4a27-be3b-8625d4a4360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Flow 'volume_create_manager' (1f16dea2-d7d7-4a7d-807a-f7f646191759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:37 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-51c82049-a37a-4618-8457-ce13e774aa6c tempest-ServerRescueNegativeTestJSON-1335547580 None] Created volume successfully. Apr 29 08:57:39 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f6de7930-4024-43be-8138-788717f73d9c tempest-GroupSnapshotsV319Test-1861549556 None] Group tempest-GroupSnapshotsV319Test-Group-3057: creating Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Flow 'volume_create_manager' (dfa4fb88-3ad1-4711-9257-db06df641a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b8863d-05d7-4810-bd9d-aa9c14c9857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:39 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f6de7930-4024-43be-8138-788717f73d9c tempest-GroupSnapshotsV319Test-1861549556 None] Group tempest-GroupSnapshotsV319Test-Group-3057: created successfully Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b8863d-05d7-4810-bd9d-aa9c14c9857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:57:39Z,deleted=False,deleted_at=None,display_description='',display_name='20b8c47e-00df-490e-83f5-815e63e537bb-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75cefd3-fb4f-4c63-b770-620350aea392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a058acfd664eb8a5b7b950654b051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:39Z,use_quota=True,user_id='23dd7129654d489c9961062ea45d3615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bf307a-d14e-49dc-b3fc-917eed29d49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bf307a-d14e-49dc-b3fc-917eed29d49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875949c1-4321-48c9-87a1-94718fa72005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875949c1-4321-48c9-87a1-94718fa72005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c75cefd3-fb4f-4c63-b770-620350aea392', 'volume_name': 'volume-c75cefd3-fb4f-4c63-b770-620350aea392', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5be910-7e48-4cef-889e-cdf6c61aa010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5be910-7e48-4cef-889e-cdf6c61aa010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ca85d0-ac10-4bdd-8a3b-35a72c677f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:39 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Volume c75cefd3-fb4f-4c63-b770-620350aea392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c75cefd3-fb4f-4c63-b770-620350aea392', 'volume_size': 1} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:57:39Z,deleted=False,deleted_at=None,display_description='',display_name='20b8c47e-00df-490e-83f5-815e63e537bb-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75cefd3-fb4f-4c63-b770-620350aea392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a058acfd664eb8a5b7b950654b051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:39Z,use_quota=True,user_id='23dd7129654d489c9961062ea45d3615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Creating volume c75cefd3-fb4f-4c63-b770-620350aea392 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:57:39 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:57:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:39 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392 1073741824 Apr 29 08:57:39 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:39 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f6de7930-4024-43be-8138-788717f73d9c tempest-GroupSnapshotsV319Test-1861549556 None] Create group completed successfully. Apr 29 08:57:41 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392 1073741824" returned: 0 in 1.442s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:41 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392 Apr 29 08:57:41 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:41 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:57:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Flow 'volume_create_manager' (da35e279-72e0-4618-8f0a-f8881aaa632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d248bc5c-6642-4b1a-aaca-b0da4686385d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d248bc5c-6642-4b1a-aaca-b0da4686385d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1569988963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1161a10d-d22a-4e8b-b95c-fee3c8fd6d36,host='devstack@QuobyteHD#QuobyteHD',id=83600b54-57bc-4ebc-89a0-1de2529b4015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29d9aa1739348bba7c72fb70e718544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:42Z,use_quota=True,user_id='5e9c4bc681ec4f3caa7175fa0cd6db78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98d2c31-cc29-4e7b-addd-88b372e97fed),volume_type_id=e98d2c31-cc29-4e7b-addd-88b372e97fed)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068c7c1b-0d73-4bda-af0f-5ddaaa0ae415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068c7c1b-0d73-4bda-af0f-5ddaaa0ae415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0119621-93e7-4c48-bc9d-dee337abb530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0119621-93e7-4c48-bc9d-dee337abb530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83600b54-57bc-4ebc-89a0-1de2529b4015', 'volume_name': 'volume-83600b54-57bc-4ebc-89a0-1de2529b4015', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89aaf86-bd4d-4e9a-a0a8-b7626222a543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89aaf86-bd4d-4e9a-a0a8-b7626222a543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0386b098-657f-4253-a59d-d38349037233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:42 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Volume 83600b54-57bc-4ebc-89a0-1de2529b4015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83600b54-57bc-4ebc-89a0-1de2529b4015', 'volume_size': 1} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:42 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392" returned: 0 in 1.280s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] <== create_volume: return (2808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.810s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.341s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1161a10d-d22a-4e8b-b95c-fee3c8fd6d36,created_at=2026-04-29T06:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1569988963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1161a10d-d22a-4e8b-b95c-fee3c8fd6d36,host='devstack@QuobyteHD#QuobyteHD',id=83600b54-57bc-4ebc-89a0-1de2529b4015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29d9aa1739348bba7c72fb70e718544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:42Z,use_quota=True,user_id='5e9c4bc681ec4f3caa7175fa0cd6db78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98d2c31-cc29-4e7b-addd-88b372e97fed),volume_type_id=e98d2c31-cc29-4e7b-addd-88b372e97fed)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Creating volume 83600b54-57bc-4ebc-89a0-1de2529b4015 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:57:42 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:42 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 1073741824 Apr 29 08:57:42 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ca85d0-ac10-4bdd-8a3b-35a72c677f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c75cefd3-fb4f-4c63-b770-620350aea392', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd63f05-5922-4f90-af9f-76586c234d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:42 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Volume volume-c75cefd3-fb4f-4c63-b770-620350aea392 (c75cefd3-fb4f-4c63-b770-620350aea392): created successfully Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd63f05-5922-4f90-af9f-76586c234d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Flow 'volume_create_manager' (dfa4fb88-3ad1-4711-9257-db06df641a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:42 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-a120f327-e721-4573-971d-6ecd2eeebf54 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Created volume successfully. Apr 29 08:57:44 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 1073741824" returned: 0 in 1.554s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:44 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 Apr 29 08:57:44 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:45 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015" returned: 0 in 1.060s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] <== create_volume: return (2765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:57:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.768s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0386b098-657f-4253-a59d-d38349037233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83600b54-57bc-4ebc-89a0-1de2529b4015', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f69b84-4848-47cb-bf7d-80a09d647baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:45 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Volume volume-83600b54-57bc-4ebc-89a0-1de2529b4015 (83600b54-57bc-4ebc-89a0-1de2529b4015): created successfully Apr 29 08:57:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f69b84-4848-47cb-bf7d-80a09d647baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Flow 'volume_create_manager' (da35e279-72e0-4618-8f0a-f8881aaa632e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:45 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-4b7599b8-d3aa-4ca0-a48c-8873b6177649 tempest-GroupSnapshotsV319Test-1861549556 None] Created volume successfully. Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Flow 'volume_create_manager' (f1df33e4-b42a-4b97-8dc2-02ad5fe5178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc74b335-1087-433a-85f6-492fc02c0b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc74b335-1087-433a-85f6-492fc02c0b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-823535505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514778bd-c6a3-4635-b896-1732a522ed96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5d8fbafdd24fd4ad330e8f8133f4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:46Z,use_quota=True,user_id='c8c1b72b00fb457a810ee8db94ae1654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b97713-88b2-4760-88c7-e1712a4f39fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b97713-88b2-4760-88c7-e1712a4f39fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca54c2da-4adf-420f-bcef-9c1013e46edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca54c2da-4adf-420f-bcef-9c1013e46edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '514778bd-c6a3-4635-b896-1732a522ed96', 'volume_name': 'volume-514778bd-c6a3-4635-b896-1732a522ed96', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83d5ae0-3248-4eab-bd7f-ed45555aedf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83d5ae0-3248-4eab-bd7f-ed45555aedf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08fb3fd-a3a9-421c-8134-5fcd037356a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:46 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Volume 514778bd-c6a3-4635-b896-1732a522ed96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-514778bd-c6a3-4635-b896-1732a522ed96', 'volume_size': 1} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-823535505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514778bd-c6a3-4635-b896-1732a522ed96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5d8fbafdd24fd4ad330e8f8133f4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:46Z,use_quota=True,user_id='c8c1b72b00fb457a810ee8db94ae1654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Creating volume 514778bd-c6a3-4635-b896-1732a522ed96 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:57:46 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-514778bd-c6a3-4635-b896-1732a522ed96 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:46 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-514778bd-c6a3-4635-b896-1732a522ed96 1073741824 Apr 29 08:57:46 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-4b826f19-854b-4a1a-9cf1-adc2142e60a9 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:46 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] GroupSnapshot 1fdd2d5e-0d78-4e8a-a2b3-34ead5c3e2c6: creating. Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] Group snapshot 1fdd2d5e-0d78-4e8a-a2b3-34ead5c3e2c6: creating. {{(pid=83712) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 08:57:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:47 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-514778bd-c6a3-4635-b896-1732a522ed96 1073741824" returned: 0 in 0.915s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-514778bd-c6a3-4635-b896-1732a522ed96 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:47 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-514778bd-c6a3-4635-b896-1732a522ed96 Apr 29 08:57:47 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:47 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-514778bd-c6a3-4635-b896-1732a522ed96" returned: 0 in 0.605s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:57:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-4b826f19-854b-4a1a-9cf1-adc2142e60a9 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.526s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08fb3fd-a3a9-421c-8134-5fcd037356a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-514778bd-c6a3-4635-b896-1732a522ed96', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287e6f76-26d4-49ff-8451-3ef5c2458967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:47 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[f488e853-ab73-4780-841e-6bcd4e69729e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-4b826f19-854b-4a1a-9cf1-adc2142e60a9 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:47 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Volume volume-514778bd-c6a3-4635-b896-1732a522ed96 (514778bd-c6a3-4635-b896-1732a522ed96): created successfully Apr 29 08:57:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287e6f76-26d4-49ff-8451-3ef5c2458967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Flow 'volume_create_manager' (f1df33e4-b42a-4b97-8dc2-02ad5fe5178a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:47 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d3cb7ad6-8fb3-4f3e-b94f-f86efa19ed56 tempest-VolumeQuotasAdminTestJSON-433435520 None] Created volume successfully. Apr 29 08:57:47 devstack sudo[86907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392 Apr 29 08:57:47 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Acquiring lock "cinder-514778bd-c6a3-4635-b896-1732a522ed96-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "cinder-514778bd-c6a3-4635-b896-1732a522ed96-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Acquiring lock "cinder-quobyte-514778bd-c6a3-4635-b896-1732a522ed96" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "cinder-quobyte-514778bd-c6a3-4635-b896-1732a522ed96" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bd8e20-c3d4-4f6f-b40e-24f5f35a072b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-514778bd-c6a3-4635-b896-1732a522ed96 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:48 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-514778bd-c6a3-4635-b896-1732a522ed96 Apr 29 08:57:48 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:48 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-4b826f19-854b-4a1a-9cf1-adc2142e60a9 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392" returned: 0 in 0.979s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-4b826f19-854b-4a1a-9cf1-adc2142e60a9 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.917s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] Creating offline snapshot df15aa98-ed33-4914-8278-ab252812742b of volume 83600b54-57bc-4ebc-89a0-1de2529b4015 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[be523a17-3228-4f42-9341-426eda6cd91d]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:48 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-4b826f19-854b-4a1a-9cf1-adc2142e60a9 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa', 'name': 'volume-c75cefd3-fb4f-4c63-b770-620350aea392', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ce8d308-63ef-444d-b11c-8753ba0259f5', 'enforce_multipath': True} {{(pid=83712) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 08:57:49 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-24c97e83-0dc4-42fa-b1b1-23414a335ab7 req-4b826f19-854b-4a1a-9cf1-adc2142e60a9 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] attachment_update completed successfully. Apr 29 08:57:49 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 Apr 29 08:57:49 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:49 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-514778bd-c6a3-4635-b896-1732a522ed96" returned: 0 in 1.297s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-514778bd-c6a3-4635-b896-1732a522ed96 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:49 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-514778bd-c6a3-4635-b896-1732a522ed96 Apr 29 08:57:49 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:49 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015" returned: 0 in 1.110s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:50 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b 1G Apr 29 08:57:50 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:50 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-514778bd-c6a3-4635-b896-1732a522ed96" returned: 0 in 0.739s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "cinder-quobyte-514778bd-c6a3-4635-b896-1732a522ed96" released by "delete_volume" :: held 2.140s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:57:50 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=78,cinder:UPDATE=82,cinder:INSERT=13,cinder:DELETE=5 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:57:50 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Created reservations ['bc723d65-2a56-4b40-ab7f-4b40508dd958', '751d5e58-128e-4598-84f6-ce764ddad138', '43d71bf1-093c-4ee9-9779-fd98277278ce', 'fb183bcd-117e-4496-bc30-b9f50276c5d0'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:57:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:50 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:57:50 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:50 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b 1G" returned: 0 in 0.959s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83600b54-57bc-4ebc-89a0-1de2529b4015 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:50 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83600b54-57bc-4ebc-89a0-1de2529b4015 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b Apr 29 08:57:50 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:52 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.243s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:52 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:57:52 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Deleted volume successfully. Apr 29 08:57:52 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=83,cinder:UPDATE=83,cinder:INSERT=21,cinder:DELETE=6 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:57:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bed763f7-4306-46aa-a79e-6dd11ef41909 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "cinder-514778bd-c6a3-4635-b896-1732a522ed96-delete_volume" released by "delete_volume" :: held 3.698s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:57:52 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83600b54-57bc-4ebc-89a0-1de2529b4015 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b" returned: 0 in 1.693s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:52 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b is being set with open permissions: ugo+rw: NotImplementedError Apr 29 08:57:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:52 devstack sudo[87051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b Apr 29 08:57:52 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:52 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Flow 'volume_create_manager' (f41fda2e-a978-4950-8ae9-2527baaaf85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d9c91e-9204-4d6f-9be8-7c53e5562652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d9c91e-9204-4d6f-9be8-7c53e5562652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1294873456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485763cd-592e-4852-bc6d-01673fe5061d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5d8fbafdd24fd4ad330e8f8133f4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:53Z,use_quota=True,user_id='c8c1b72b00fb457a810ee8db94ae1654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91408c9b-cae6-46f5-8905-e752e91868c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91408c9b-cae6-46f5-8905-e752e91868c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d08b040-798d-47dc-9155-4f453ba65736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d08b040-798d-47dc-9155-4f453ba65736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '485763cd-592e-4852-bc6d-01673fe5061d', 'volume_name': 'volume-485763cd-592e-4852-bc6d-01673fe5061d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70f41f6-10fd-4063-a85f-d30465ae91a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70f41f6-10fd-4063-a85f-d30465ae91a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fac4f4b-e767-40b6-a627-58c3781bd8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:53 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Volume 485763cd-592e-4852-bc6d-01673fe5061d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-485763cd-592e-4852-bc6d-01673fe5061d', 'volume_size': 1} Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:53 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b" returned: 0 in 0.918s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:53 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.info Apr 29 08:57:53 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:54 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.info" returned: 0 in 0.735s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:54 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 08:57:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:54 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.info Apr 29 08:57:54 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:55 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.info" returned: 0 in 0.877s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.432s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.134s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1294873456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485763cd-592e-4852-bc6d-01673fe5061d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5d8fbafdd24fd4ad330e8f8133f4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:57:53Z,use_quota=True,user_id='c8c1b72b00fb457a810ee8db94ae1654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:57:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Creating volume 485763cd-592e-4852-bc6d-01673fe5061d {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:57:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:57:55 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:57:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-485763cd-592e-4852-bc6d-01673fe5061d 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:55 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-485763cd-592e-4852-bc6d-01673fe5061d 1073741824 Apr 29 08:57:55 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:55 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-5196ffa4-fc79-4e45-9a2b-3b6b13f4cff8 tempest-GroupSnapshotsV319Test-1861549556 None] group_snapshot 1fdd2d5e-0d78-4e8a-a2b3-34ead5c3e2c6: created successfully Apr 29 08:57:56 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-485763cd-592e-4852-bc6d-01673fe5061d 1073741824" returned: 0 in 1.606s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-485763cd-592e-4852-bc6d-01673fe5061d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:56 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-485763cd-592e-4852-bc6d-01673fe5061d Apr 29 08:57:56 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:57 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] group_snapshot 1fdd2d5e-0d78-4e8a-a2b3-34ead5c3e2c6: deleting Apr 29 08:57:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] group_snapshot 1fdd2d5e-0d78-4e8a-a2b3-34ead5c3e2c6: deleting {{(pid=83712) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 08:57:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Acquiring lock "cinder-quobyte-83600b54-57bc-4ebc-89a0-1de2529b4015" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Lock "cinder-quobyte-83600b54-57bc-4ebc-89a0-1de2529b4015" acquired by "delete_snapshot" :: waited 0.041s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Acquiring lock "cinder-quobyte-df15aa98-ed33-4914-8278-ab252812742b" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Lock "cinder-quobyte-df15aa98-ed33-4914-8278-ab252812742b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Deleting offline snapshot df15aa98-ed33-4914-8278-ab252812742b of volume 83600b54-57bc-4ebc-89a0-1de2529b4015 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 08:57:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] snapshot_file for this snap is: volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 08:57:57 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e027801-b7e9-4a59-a6ea-5ff99a4b0c50]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:58 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b Apr 29 08:57:58 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:58 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-485763cd-592e-4852-bc6d-01673fe5061d" returned: 0 in 1.344s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] <== create_volume: return (3048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:57:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.051s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fac4f4b-e767-40b6-a627-58c3781bd8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-485763cd-592e-4852-bc6d-01673fe5061d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e55476-c332-4c3f-9ce7-614321420209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:57:58 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Volume volume-485763cd-592e-4852-bc6d-01673fe5061d (485763cd-592e-4852-bc6d-01673fe5061d): created successfully Apr 29 08:57:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e55476-c332-4c3f-9ce7-614321420209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:57:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Flow 'volume_create_manager' (f41fda2e-a978-4950-8ae9-2527baaaf85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:57:58 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a3e4fcaf-8124-4fab-9967-8c1c077f51f9 tempest-VolumeQuotasAdminTestJSON-433435520 None] Created volume successfully. Apr 29 08:57:58 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 29 08:57:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b" returned: 0 in 0.819s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:57:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83600b54-57bc-4ebc-89a0-1de2529b4015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 08:57:58 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[895d9dbf-a025-4748-9d86-4ad5b32e8c4a]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:58 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 Apr 29 08:57:58 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Acquiring lock "cinder-857fb49a-3a8b-4af4-a0af-4642e3a3aa85-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Lock "cinder-857fb49a-3a8b-4af4-a0af-4642e3a3aa85-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Acquiring lock "cinder-quobyte-857fb49a-3a8b-4af4-a0af-4642e3a3aa85" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Lock "cinder-quobyte-857fb49a-3a8b-4af4-a0af-4642e3a3aa85" acquired by "delete_volume" :: waited 0.052s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[8594aa79-bc03-4070-95d7-c6759d633e92]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:57:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:57:59 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:57:59 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:57:59 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-18742438-9308-420d-bdd6-8503a2b619aa tempest-VolumeQuotasAdminTestJSON-1005747772 None] Transfer volume completed successfully. Apr 29 08:57:59 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85 Apr 29 08:57:59 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:00 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015" returned: 0 in 1.343s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:00 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b Apr 29 08:58:00 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:00 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.273s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:58:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Acquiring lock "cinder-485763cd-592e-4852-bc6d-01673fe5061d-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Lock "cinder-485763cd-592e-4852-bc6d-01673fe5061d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:00 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85" returned: 0 in 1.373s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:01 devstack sudo[87528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85 Apr 29 08:58:01 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Acquiring lock "cinder-quobyte-485763cd-592e-4852-bc6d-01673fe5061d" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Lock "cinder-quobyte-485763cd-592e-4852-bc6d-01673fe5061d" acquired by "delete_volume" :: waited 0.043s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:01 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f712969-2606-4917-8985-d25ba0abb6aa]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-485763cd-592e-4852-bc6d-01673fe5061d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:01 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-485763cd-592e-4852-bc6d-01673fe5061d Apr 29 08:58:01 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:01 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b" returned: 0 in 1.438s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:01 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b Apr 29 08:58:01 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:01 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-857fb49a-3a8b-4af4-a0af-4642e3a3aa85" returned: 0 in 0.918s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Lock "cinder-quobyte-857fb49a-3a8b-4af4-a0af-4642e3a3aa85" released by "delete_volume" :: held 2.413s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Created reservations ['513b0583-69a4-47df-ab2d-5669cda4d511', '21239e87-b5be-418f-8e69-4af2bab3fe94', '3ed8a8e8-1a02-446d-8e35-dc1d761b3878', '53c354f8-14ee-4419-a755-377726634ec7'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:02 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:58:02 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:02 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-485763cd-592e-4852-bc6d-01673fe5061d" returned: 0 in 1.170s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-485763cd-592e-4852-bc6d-01673fe5061d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:02 devstack sudo[87544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-485763cd-592e-4852-bc6d-01673fe5061d Apr 29 08:58:02 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:02 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015.df15aa98-ed33-4914-8278-ab252812742b" returned: 0 in 0.879s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Lock "cinder-quobyte-df15aa98-ed33-4914-8278-ab252812742b" released by "_delete_snapshot" :: held 4.650s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Lock "cinder-quobyte-83600b54-57bc-4ebc-89a0-1de2529b4015" released by "delete_snapshot" :: held 4.699s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:02 devstack cinder-volume[83712]: WARNING cinder.quota [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-823837650 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-823837650, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:58:02 devstack cinder-volume[83712]: WARNING cinder.quota [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-823837650 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-823837650, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] Created reservations ['d0f46604-92a9-4b3d-b9fa-714b2faa702c', '8fa016e4-accc-483a-9b2d-fe3793350f01', 'fc830148-e2f7-496d-b9b7-3ce35b947213', '01bcc545-14fc-423c-ab35-a8bd079bb1f1'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:58:02 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-fe41f0fb-68d3-4480-82c8-fcc91bd0bfba tempest-GroupSnapshotsV319Test-1861549556 None] group_snapshot 1fdd2d5e-0d78-4e8a-a2b3-34ead5c3e2c6: deleted successfully Apr 29 08:58:02 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.849s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:02 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:58:02 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Deleted volume successfully. Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6b11590e-f8f6-438c-971e-a19671c281fd tempest-ServerRescueNegativeTestJSON-1335547580 None] Lock "cinder-857fb49a-3a8b-4af4-a0af-4642e3a3aa85-delete_volume" released by "delete_volume" :: held 3.662s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:03 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-485763cd-592e-4852-bc6d-01673fe5061d" returned: 0 in 0.879s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Lock "cinder-quobyte-485763cd-592e-4852-bc6d-01673fe5061d" released by "delete_volume" :: held 2.112s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Created reservations ['21359933-afe6-4c7f-b325-20f26ab8ad1f', '4be8358e-4b17-494a-8595-944cc8cf8a2c', '23812a91-b435-42dd-8726-354187b5c613', '4521f731-bd05-437e-9b6b-a5f7b8f2c6ee'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:03 devstack sudo[87550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:58:03 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Acquiring lock "cinder-quobyte-83600b54-57bc-4ebc-89a0-1de2529b4015" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Lock "cinder-quobyte-83600b54-57bc-4ebc-89a0-1de2529b4015" acquired by "delete_volume" :: waited 0.048s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d58998-4a1d-4417-9993-c7c1d9a5c955]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:04 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 Apr 29 08:58:04 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:04 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.325s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:04 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:58:04 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Deleted volume successfully. Apr 29 08:58:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f3ca16-abd6-453a-91ea-b6e32164e379 tempest-VolumeQuotasAdminTestJSON-1077878011 None] Lock "cinder-485763cd-592e-4852-bc6d-01673fe5061d-delete_volume" released by "delete_volume" :: held 3.781s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:05 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015" returned: 0 in 1.530s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:05 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015 Apr 29 08:58:05 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:07 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-83600b54-57bc-4ebc-89a0-1de2529b4015" returned: 0 in 1.594s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Lock "cinder-quobyte-83600b54-57bc-4ebc-89a0-1de2529b4015" released by "delete_volume" :: held 3.248s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:07 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Created reservations ['a96aa626-e66a-4b5b-b695-df4db85531e0'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:58:07 devstack cinder-volume[83712]: WARNING cinder.quota [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-823837650 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-823837650, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:58:07 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Created reservations ['3a3679af-963f-465a-80a9-10fae2ea37cb', '5ee9c6b8-525b-4fd2-ab0f-04a53dfb893d', '3a0aaed9-0dfa-4504-9e12-596ce62ac5f2', '7e7fa456-6652-44d6-86b9-f38263e5c8aa'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:58:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:07 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:58:07 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:09 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.497s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:09 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:58:09 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8b367787-76f7-4cd3-a6c8-a2634356b20d tempest-GroupSnapshotsV319Test-1861549556 None] Delete group completed successfully. Apr 29 08:58:15 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e5f99042-40e5-4a4a-b133-789ad9965457 tempest-GroupsV314Test-2021187420 None] Group tempest-GroupsV314Test-Group-838087469: creating Apr 29 08:58:15 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e5f99042-40e5-4a4a-b133-789ad9965457 tempest-GroupsV314Test-2021187420 None] Group tempest-GroupsV314Test-Group-838087469: created successfully Apr 29 08:58:15 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e5f99042-40e5-4a4a-b133-789ad9965457 tempest-GroupsV314Test-2021187420 None] Create group completed successfully. Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Flow 'volume_create_manager' (6d2e2b47-c5f6-4f5e-a2c1-cc80ce2d171b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62927686-c982-4d84-92d5-77644f8d0c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62927686-c982-4d84-92d5-77644f8d0c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-997258674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d99702c-c3a5-492b-b7a9-76aabe34a63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1331afd96f12452b84e4eacc2d03efb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:16Z,use_quota=True,user_id='9fdba02d172b40fc836bd3063952b953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a72fd1c-8a46-4f54-8c08-aec20ce6165e),volume_type_id=5a72fd1c-8a46-4f54-8c08-aec20ce6165e)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35aa26b7-12fe-46d9-bd9f-3e42c95dc6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35aa26b7-12fe-46d9-bd9f-3e42c95dc6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c2bfbb-85be-489f-89b3-9301e41c07e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c2bfbb-85be-489f-89b3-9301e41c07e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d99702c-c3a5-492b-b7a9-76aabe34a63f', 'volume_name': 'volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50066d96-7949-44e8-bc6a-d1e85ff18f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50066d96-7949-44e8-bc6a-d1e85ff18f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c05210b-60ed-4814-ac92-53dbd2fa7a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:15 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Volume 2d99702c-c3a5-492b-b7a9-76aabe34a63f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f', 'volume_size': 1} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-997258674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d99702c-c3a5-492b-b7a9-76aabe34a63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1331afd96f12452b84e4eacc2d03efb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:16Z,use_quota=True,user_id='9fdba02d172b40fc836bd3063952b953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a72fd1c-8a46-4f54-8c08-aec20ce6165e),volume_type_id=5a72fd1c-8a46-4f54-8c08-aec20ce6165e)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Creating volume 2d99702c-c3a5-492b-b7a9-76aabe34a63f {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:58:15 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:58:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:15 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f 1073741824 Apr 29 08:58:15 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:16 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f 1073741824" returned: 0 in 1.080s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:16 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f Apr 29 08:58:16 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Flow 'volume_create_manager' (6f091b26-220c-405e-aa9f-5484f2f2f4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a0b3e6-d962-4b03-afb9-5e7ec28fbcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a0b3e6-d962-4b03-afb9-5e7ec28fbcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-171643638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=80dc3970-e90b-45e6-af58-0b213ec88b03,host='devstack@QuobyteHD#QuobyteHD',id=23311bf0-9e86-49aa-8c77-8ca0f21765eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c847f17d1c1c493585d2d949421997f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:17Z,use_quota=True,user_id='ede25a41ee714cfeb45ae00cb8e9caec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3113683-2a9c-4d39-8ca2-8626645d9711),volume_type_id=d3113683-2a9c-4d39-8ca2-8626645d9711)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4dcbfb-3064-4199-9907-39255fb8e5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4dcbfb-3064-4199-9907-39255fb8e5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d9b62a-ec84-4b69-bd8d-1ee5604f8f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d9b62a-ec84-4b69-bd8d-1ee5604f8f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23311bf0-9e86-49aa-8c77-8ca0f21765eb', 'volume_name': 'volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21374890-4a8c-4acd-a930-d53961cf8acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21374890-4a8c-4acd-a930-d53961cf8acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816289b3-2818-4cac-aca4-49bfced22aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:17 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Volume 23311bf0-9e86-49aa-8c77-8ca0f21765eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb', 'volume_size': 1} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:17 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f" returned: 0 in 0.852s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.441s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=80dc3970-e90b-45e6-af58-0b213ec88b03,created_at=2026-04-29T06:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-171643638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=80dc3970-e90b-45e6-af58-0b213ec88b03,host='devstack@QuobyteHD#QuobyteHD',id=23311bf0-9e86-49aa-8c77-8ca0f21765eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c847f17d1c1c493585d2d949421997f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:17Z,use_quota=True,user_id='ede25a41ee714cfeb45ae00cb8e9caec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3113683-2a9c-4d39-8ca2-8626645d9711),volume_type_id=d3113683-2a9c-4d39-8ca2-8626645d9711)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Creating volume 23311bf0-9e86-49aa-8c77-8ca0f21765eb {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:58:17 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:17 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb 1073741824 Apr 29 08:58:17 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c05210b-60ed-4814-ac92-53dbd2fa7a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487e2c89-c57a-4222-83b2-3ba48eab4e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:17 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Volume volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f (2d99702c-c3a5-492b-b7a9-76aabe34a63f): created successfully Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487e2c89-c57a-4222-83b2-3ba48eab4e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Flow 'volume_create_manager' (6d2e2b47-c5f6-4f5e-a2c1-cc80ce2d171b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:17 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a933aca0-70a2-4d30-ab20-bdf0d9bf55f6 tempest-VolumeTypesAccessTest-246181863 None] Created volume successfully. Apr 29 08:58:18 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb 1073741824" returned: 0 in 1.040s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:18 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb Apr 29 08:58:18 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Acquiring lock "cinder-2d99702c-c3a5-492b-b7a9-76aabe34a63f-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Lock "cinder-2d99702c-c3a5-492b-b7a9-76aabe34a63f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Acquiring lock "cinder-quobyte-2d99702c-c3a5-492b-b7a9-76aabe34a63f" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Lock "cinder-quobyte-2d99702c-c3a5-492b-b7a9-76aabe34a63f" acquired by "delete_volume" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeb4bb2-cc5e-4808-9ce1-24f25b5a692a]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:19 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f Apr 29 08:58:19 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:19 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb" returned: 0 in 0.940s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816289b3-2818-4cac-aca4-49bfced22aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490ec4dc-c52c-4c73-841c-d8d0510eaf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:19 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Volume volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb (23311bf0-9e86-49aa-8c77-8ca0f21765eb): created successfully Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490ec4dc-c52c-4c73-841c-d8d0510eaf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Flow 'volume_create_manager' (6f091b26-220c-405e-aa9f-5484f2f2f4e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:19 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c6fe6e96-684e-4d5d-9cc3-6172a7fdb1d7 tempest-GroupsV314Test-2021187420 None] Created volume successfully. Apr 29 08:58:20 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f" returned: 0 in 1.114s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:20 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f Apr 29 08:58:20 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:21 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2d99702c-c3a5-492b-b7a9-76aabe34a63f" returned: 0 in 0.877s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Lock "cinder-quobyte-2d99702c-c3a5-492b-b7a9-76aabe34a63f" released by "delete_volume" :: held 2.081s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:21 devstack cinder-volume[83712]: WARNING cinder.quota [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1898566506 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1898566506, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:58:21 devstack cinder-volume[83712]: WARNING cinder.quota [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1898566506 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1898566506, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:58:21 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Created reservations ['4dfe63eb-38c1-4899-b33e-ba35ef35949e', '05739961-6eac-4385-83ef-cb022baf6684', '61073e26-61d5-4bf9-b45f-c2299401a868', '6f9208e8-92ca-4b36-8be3-1e979afc1d7b'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:58:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:21 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:58:21 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:22 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Cloning volume 23311bf0-9e86-49aa-8c77-8ca0f21765eb to volume 646decba-da00-4807-9a96-317426a43ac5 Apr 29 08:58:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Creating offline snapshot 8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 of volume 23311bf0-9e86-49aa-8c77-8ca0f21765eb {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 08:58:22 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e65b692-2673-4474-a95a-c0b6aaef2bb9]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:22 devstack sudo[87892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb Apr 29 08:58:22 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:22 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.061s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:22 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:58:22 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Deleted volume successfully. Apr 29 08:58:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f3de24b7-dc62-452b-9f54-f857bb0ee228 tempest-VolumeTypesAccessTest-246181863 None] Lock "cinder-2d99702c-c3a5-492b-b7a9-76aabe34a63f-delete_volume" released by "delete_volume" :: held 3.631s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:23 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb" returned: 0 in 1.193s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:23 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 1G Apr 29 08:58:23 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:24 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 1G" returned: 0 in 1.208s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:24 devstack sudo[87910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 Apr 29 08:58:24 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:25 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1" returned: 0 in 0.866s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:25 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 08:58:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:25 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 Apr 29 08:58:25 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:26 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1" returned: 0 in 0.805s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:26 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.info Apr 29 08:58:26 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:27 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.info" returned: 0 in 0.713s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:27 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:27 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.info Apr 29 08:58:27 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:27 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.info" returned: 0 in 0.664s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Acquiring lock "cinder-quobyte-646decba-da00-4807-9a96-317426a43ac5" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Lock "cinder-quobyte-646decba-da00-4807-9a96-317426a43ac5" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] snapshot: 8ac3131a-3f1b-4356-ba7d-6f092f65a5e1, volume: 646decba-da00-4807-9a96-317426a43ac5, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c920e9f-4a28-4318-87c7-035747991d04]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:27 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 Apr 29 08:58:27 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Flow 'volume_create_manager' (cd6dc905-6c9c-4abf-b492-8d4b81808312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b025d6-8547-44df-8071-1b488a0c053a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b025d6-8547-44df-8071-1b488a0c053a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-742142010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075c72ea-30d8-4517-b6b0-eca5ab56db4d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfc4862d1ce744009ec0b3787b5e12fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:28Z,use_quota=True,user_id='e10c1be415ba4902b35c8e2d4c6da208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad6404e-4b54-4ea2-91bf-7190748582b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad6404e-4b54-4ea2-91bf-7190748582b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b78cccc-ee97-4d8c-ab19-4c0906b0cf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b78cccc-ee97-4d8c-ab19-4c0906b0cf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075c72ea-30d8-4517-b6b0-eca5ab56db4d', 'volume_name': 'volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15543c6b-98ed-4970-9829-5036ab34ccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15543c6b-98ed-4970-9829-5036ab34ccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7befd4f-8230-42f8-9e60-1206b2a0926f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:28 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Volume 075c72ea-30d8-4517-b6b0-eca5ab56db4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d', 'volume_size': 1} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:28 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1" returned: 0 in 0.927s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[17980a6c-c655-49e4-97d4-b04a0ca09ce9]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:28 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb Apr 29 08:58:28 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:29 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb" returned: 0 in 0.992s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:29 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5 not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 08:58:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:29 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5 Apr 29 08:58:29 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:36 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:UPDATE=60,cinder:SELECT=46,cinder:INSERT=10,cinder:DELETE=6 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:58:36 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5" returned: 0 in 6.648s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:36 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca98ee63-5b35-4233-96b7-9aaca5ab97c5]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:36 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb Apr 29 08:58:36 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:37 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb" returned: 0 in 0.993s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:37 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5 {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 08:58:37 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Converted 1024.00 MB image at 154.01 MB/s Apr 29 08:58:37 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 08:58:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:37 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5 Apr 29 08:58:37 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:38 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5" returned: 0 in 0.639s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Lock "cinder-quobyte-646decba-da00-4807-9a96-317426a43ac5" released by "_copy_volume_from_snapshot" :: held 10.325s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Acquiring lock "cinder-quobyte-8ac3131a-3f1b-4356-ba7d-6f092f65a5e1" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Lock "cinder-quobyte-8ac3131a-3f1b-4356-ba7d-6f092f65a5e1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:38 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Deleting offline snapshot 8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 of volume 23311bf0-9e86-49aa-8c77-8ca0f21765eb {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 08:58:38 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] snapshot_file for this snap is: volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 08:58:38 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[282dbccb-81c3-42ff-9e6d-db582bacbf02]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:38 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 Apr 29 08:58:38 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:39 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1" returned: 0 in 1.129s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 08:58:39 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1677a3-eec0-400b-af0a-adec084cecd0]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:39 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb Apr 29 08:58:39 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:40 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb" returned: 0 in 0.875s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:40 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 Apr 29 08:58:40 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Flow 'volume_create_manager' (3c8a5f52-c9ac-44d2-b88e-446b4e76d3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99105a43-77a2-4de7-b280-d914e142243d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99105a43-77a2-4de7-b280-d914e142243d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-873566609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4f128e84a44c5a919c4a42b6bbe162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:41Z,use_quota=True,user_id='788c1e242ac342e1b7ae2f62a9a2021f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ec94cc-d854-40b1-a370-36022702b0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ec94cc-d854-40b1-a370-36022702b0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b45ccd0-0166-456a-9fce-e68d35837cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b45ccd0-0166-456a-9fce-e68d35837cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d', 'volume_name': 'volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f65b519-bbfd-4dab-ae1c-402c69e7c369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f65b519-bbfd-4dab-ae1c-402c69e7c369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:41 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee59012-d964-4cad-9c32-7b501aa96b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:41 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Volume ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d', 'volume_size': 1} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1" returned: 0 in 0.959s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:41 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1 Apr 29 08:58:41 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:41 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb.8ac3131a-3f1b-4356-ba7d-6f092f65a5e1" returned: 0 in 0.699s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Lock "cinder-quobyte-8ac3131a-3f1b-4356-ba7d-6f092f65a5e1" released by "_delete_snapshot" :: held 3.790s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.861s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.278s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-742142010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075c72ea-30d8-4517-b6b0-eca5ab56db4d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfc4862d1ce744009ec0b3787b5e12fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:28Z,use_quota=True,user_id='e10c1be415ba4902b35c8e2d4c6da208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Creating volume 075c72ea-30d8-4517-b6b0-eca5ab56db4d {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:58:41 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:58:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:42 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d 1073741824 Apr 29 08:58:42 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:42 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-2998584b-d2c7-4691-87d6-2f1679d1fa2c tempest-GroupsV314Test-2021187420 None] Create group from source-group-80dc3970-e90b-45e6-af58-0b213ec88b03 completed successfully. Apr 29 08:58:42 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d 1073741824" returned: 0 in 0.996s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:42 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d Apr 29 08:58:42 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Acquiring lock "cinder-quobyte-646decba-da00-4807-9a96-317426a43ac5" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Lock "cinder-quobyte-646decba-da00-4807-9a96-317426a43ac5" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d22f6a-ed2a-4bfe-9780-0d9c25f320bb]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:43 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5 Apr 29 08:58:43 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:43 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d" returned: 0 in 0.836s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.691s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-873566609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4f128e84a44c5a919c4a42b6bbe162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:41Z,use_quota=True,user_id='788c1e242ac342e1b7ae2f62a9a2021f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Creating volume ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:58:43 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7befd4f-8230-42f8-9e60-1206b2a0926f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:43 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d 1073741824 Apr 29 08:58:43 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0bd104-eca1-495a-88c6-d20428587b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:43 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Volume volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d (075c72ea-30d8-4517-b6b0-eca5ab56db4d): created successfully Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0bd104-eca1-495a-88c6-d20428587b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Flow 'volume_create_manager' (cd6dc905-6c9c-4abf-b492-8d4b81808312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:44 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-8fef00e4-0a5a-40bf-ae62-f1ebdf92e609 req-f1ca36b3-11de-417a-8094-dd07ef1acb9b tempest-VolumesGetTestJSON-589715013 None] Created volume successfully. Apr 29 08:58:44 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5" returned: 0 in 0.960s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:44 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5 Apr 29 08:58:44 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:45 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d 1073741824" returned: 0 in 1.274s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:45 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d Apr 29 08:58:45 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Acquiring lock "cinder-075c72ea-30d8-4517-b6b0-eca5ab56db4d-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Lock "cinder-075c72ea-30d8-4517-b6b0-eca5ab56db4d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Acquiring lock "cinder-quobyte-075c72ea-30d8-4517-b6b0-eca5ab56db4d" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Lock "cinder-quobyte-075c72ea-30d8-4517-b6b0-eca5ab56db4d" acquired by "delete_volume" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:45 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c70bc7-a6a5-40bf-bf3a-ce9213779dd9]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:45 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-646decba-da00-4807-9a96-317426a43ac5" returned: 0 in 1.016s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Lock "cinder-quobyte-646decba-da00-4807-9a96-317426a43ac5" released by "delete_volume" :: held 2.065s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:45 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d Apr 29 08:58:45 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:45 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Created reservations ['b5e876fa-958d-467e-b367-b5e326a8b368'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:58:45 devstack cinder-volume[83712]: WARNING cinder.quota [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1204297563 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1204297563, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:58:45 devstack cinder-volume[83712]: WARNING cinder.quota [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1204297563 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1204297563, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:58:45 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Created reservations ['6808d755-587a-4b00-8369-4e67ece455c8', 'e76530b9-447a-4e82-ab45-e7a0f8f0a5da', '7ff44515-5726-49fc-a199-a006ee8e61af', '37303294-8d8b-4cb4-87b2-40b267d1e58f'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:46 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d" returned: 0 in 0.927s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] <== create_volume: return (2283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.286s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:46 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:58:46 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee59012-d964-4cad-9c32-7b501aa96b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0382a4a0-0868-4f49-a912-20354d9e0e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:46 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Volume volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d (ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d): created successfully Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0382a4a0-0868-4f49-a912-20354d9e0e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Flow 'volume_create_manager' (3c8a5f52-c9ac-44d2-b88e-446b4e76d3d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:46 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c8574d9a-a2f1-42f5-864d-bbd361e93c93 tempest-VolumesListAdminTestJSON-573977379 None] Created volume successfully. Apr 29 08:58:46 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d" returned: 0 in 1.354s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:46 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d Apr 29 08:58:46 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:47 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.073s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:58:47 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d66e5686-a692-4f08-85a9-da25649eb1c9 tempest-GroupsV314Test-2021187420 None] Delete group completed successfully. Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Flow 'volume_create_manager' (af74d5ee-930f-493e-8b24-d14e23634e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f89392-6c50-4392-92d3-63380bb4f3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f89392-6c50-4392-92d3-63380bb4f3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1476432602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a722d1-a28c-4c2d-9b36-d85f0365de82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4f128e84a44c5a919c4a42b6bbe162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:47Z,use_quota=True,user_id='788c1e242ac342e1b7ae2f62a9a2021f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa70f155-458b-4e7d-bf4a-7fb9fb285f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa70f155-458b-4e7d-bf4a-7fb9fb285f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114792b9-16f1-4cdc-b50a-97ab6e8e3004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114792b9-16f1-4cdc-b50a-97ab6e8e3004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a722d1-a28c-4c2d-9b36-d85f0365de82', 'volume_name': 'volume-44a722d1-a28c-4c2d-9b36-d85f0365de82', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8851e7-3e45-4dc1-83be-ab89d07e4f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8851e7-3e45-4dc1-83be-ab89d07e4f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483faf02-210e-4ebc-9034-b261cf5f1732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:47 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Volume 44a722d1-a28c-4c2d-9b36-d85f0365de82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a722d1-a28c-4c2d-9b36-d85f0365de82', 'volume_size': 1} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1476432602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a722d1-a28c-4c2d-9b36-d85f0365de82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4f128e84a44c5a919c4a42b6bbe162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:47Z,use_quota=True,user_id='788c1e242ac342e1b7ae2f62a9a2021f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Creating volume 44a722d1-a28c-4c2d-9b36-d85f0365de82 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:58:47 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-44a722d1-a28c-4c2d-9b36-d85f0365de82 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Acquiring lock "cinder-quobyte-23311bf0-9e86-49aa-8c77-8ca0f21765eb" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:47 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-44a722d1-a28c-4c2d-9b36-d85f0365de82 1073741824 Apr 29 08:58:47 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Lock "cinder-quobyte-23311bf0-9e86-49aa-8c77-8ca0f21765eb" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd83161-2ab9-4b86-81f9-ed9a354740c4]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:47 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb Apr 29 08:58:47 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:47 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-075c72ea-30d8-4517-b6b0-eca5ab56db4d" returned: 0 in 1.008s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Lock "cinder-quobyte-075c72ea-30d8-4517-b6b0-eca5ab56db4d" released by "delete_volume" :: held 2.416s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:47 devstack cinder-volume[83712]: DEBUG cinder.quota [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Created reservations ['269ad115-bb70-48f0-88dd-af4316bf6e40', '89c4c326-4ef0-42d5-82b7-c9e5a9267be2', 'e6cd18e2-3048-454a-a4e1-37467ab6b206', '05d7b836-e926-4f2e-a33d-1e97b24f978e'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:58:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:48 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:58:48 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:48 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb" returned: 0 in 1.183s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:48 devstack sudo[88190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb Apr 29 08:58:48 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:48 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-44a722d1-a28c-4c2d-9b36-d85f0365de82 1073741824" returned: 0 in 1.425s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-44a722d1-a28c-4c2d-9b36-d85f0365de82 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:49 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-44a722d1-a28c-4c2d-9b36-d85f0365de82 Apr 29 08:58:49 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:49 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.233s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:49 devstack cinder-volume[83712]: DEBUG cinder.manager [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:58:49 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Deleted volume successfully. Apr 29 08:58:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-8b9a466d-4dc3-4f29-a7a9-19c469ebf183 req-471b2dfa-783d-4051-a17f-8837b04d1764 tempest-VolumesGetTestJSON-589715013 None] Lock "cinder-075c72ea-30d8-4517-b6b0-eca5ab56db4d-delete_volume" released by "delete_volume" :: held 4.024s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:49 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-23311bf0-9e86-49aa-8c77-8ca0f21765eb" returned: 0 in 1.042s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Lock "cinder-quobyte-23311bf0-9e86-49aa-8c77-8ca0f21765eb" released by "delete_volume" :: held 2.337s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Created reservations ['7b466cb1-e638-459d-9c70-5c89a65d1b9c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Created reservations ['9c5e7601-918b-43a0-9d52-a99389b4247f', 'ce699905-e49e-4458-bb0d-ce100c926287', 'bdfcf3ec-253b-4a0c-a7b6-00ea4a49d0f8', '5d6524c3-1aed-4f33-be8e-102a89a88583'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:50 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:58:50 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:50 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-44a722d1-a28c-4c2d-9b36-d85f0365de82" returned: 0 in 1.368s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] <== create_volume: return (2889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.893s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483faf02-210e-4ebc-9034-b261cf5f1732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a722d1-a28c-4c2d-9b36-d85f0365de82', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a7ce4f-4a04-4779-9d39-2b2478330c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:50 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Volume volume-44a722d1-a28c-4c2d-9b36-d85f0365de82 (44a722d1-a28c-4c2d-9b36-d85f0365de82): created successfully Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a7ce4f-4a04-4779-9d39-2b2478330c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Flow 'volume_create_manager' (af74d5ee-930f-493e-8b24-d14e23634e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:50 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a9fbb09e-4162-4095-b7b4-0b3a491cd585 tempest-VolumesListAdminTestJSON-573977379 None] Created volume successfully. Apr 29 08:58:51 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.852s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:51 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:58:51 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ebfe3818-4604-4db7-adf7-6c0fec8a56a5 tempest-GroupsV314Test-2021187420 None] Delete group completed successfully. Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:INSERT=29,cinder:UPDATE=101,cinder:SELECT=81,cinder:DELETE=3 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Flow 'volume_create_manager' (6ced2658-a083-485d-bc15-1301a41cf125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282a7329-1616-4abc-b3d0-9cbb919b5911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282a7329-1616-4abc-b3d0-9cbb919b5911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1009855820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053e3915-3106-40b3-b4de-e8cd3c9df7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4f128e84a44c5a919c4a42b6bbe162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:53Z,use_quota=True,user_id='788c1e242ac342e1b7ae2f62a9a2021f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b8e812-c358-42be-9eb6-2e9009a85954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b8e812-c358-42be-9eb6-2e9009a85954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092f4dca-609c-4b79-bede-ade28f57bfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092f4dca-609c-4b79-bede-ade28f57bfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '053e3915-3106-40b3-b4de-e8cd3c9df7b6', 'volume_name': 'volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa07e7b-346b-4568-abfe-0a80a086fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa07e7b-346b-4568-abfe-0a80a086fe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3522cb6-28cf-4878-8ddd-8085af0e3c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:52 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Volume 053e3915-3106-40b3-b4de-e8cd3c9df7b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6', 'volume_size': 1} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1009855820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053e3915-3106-40b3-b4de-e8cd3c9df7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4f128e84a44c5a919c4a42b6bbe162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:53Z,use_quota=True,user_id='788c1e242ac342e1b7ae2f62a9a2021f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Creating volume 053e3915-3106-40b3-b4de-e8cd3c9df7b6 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:58:52 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:58:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:52 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6 1073741824 Apr 29 08:58:52 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:54 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6 1073741824" returned: 0 in 1.258s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:54 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6 Apr 29 08:58:54 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:55 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6" returned: 0 in 0.858s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:58:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3522cb6-28cf-4878-8ddd-8085af0e3c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711b2be0-ee56-409a-9049-9a53846b024e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:55 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Volume volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6 (053e3915-3106-40b3-b4de-e8cd3c9df7b6): created successfully Apr 29 08:58:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711b2be0-ee56-409a-9049-9a53846b024e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Flow 'volume_create_manager' (6ced2658-a083-485d-bc15-1301a41cf125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:55 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-bf6d0c07-81e9-4aad-a7f3-34484a6f69b0 tempest-VolumesListAdminTestJSON-573977379 None] Created volume successfully. Apr 29 08:58:56 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-886f0b61-cd30-488f-a7df-cebcb5a813fc tempest-BackendsCapabilitiesAdminTestsJSON-900484537 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6515731811523, 'free_capacity_gb': 1775.6515731811523, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83712) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 08:58:56 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5b63b5ec-bbca-44da-937c-f5c804ba0edb tempest-BackendsCapabilitiesAdminTestsJSON-900484537 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6515731811523, 'free_capacity_gb': 1775.6515731811523, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83712) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Flow 'volume_create_manager' (181616e3-f0bb-4c57-9d72-2cf9e32615fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f4dac2-250d-45d2-80fa-cf4858826986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f4dac2-250d-45d2-80fa-cf4858826986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e1144874d540aeb1f439c9fc994881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:57Z,use_quota=True,user_id='b531fe8744c54709a5e496099e216b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a952a63-aff1-4ef6-93bc-391967fecdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a952a63-aff1-4ef6-93bc-391967fecdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f15d0b-0001-4bb6-8a3e-00aeb3c92e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f15d0b-0001-4bb6-8a3e-00aeb3c92e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8dd7d11-e5e9-4198-a418-eeaa8ea2b28f', 'volume_name': 'volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b26398c-471c-45bd-8f6a-a1cac62f2c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b26398c-471c-45bd-8f6a-a1cac62f2c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a60aa5-0d16-46b5-836a-778f9f5b5ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:57 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Volume d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f', 'volume_size': 1} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e1144874d540aeb1f439c9fc994881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:58:57Z,use_quota=True,user_id='b531fe8744c54709a5e496099e216b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Creating volume d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:58:57 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:58:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:57 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f 1073741824 Apr 29 08:58:57 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:58 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f 1073741824" returned: 0 in 0.990s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:58 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-66c1ae50-97a5-4397-85a1-0ba68086a14c tempest-GroupsV320Test-734524530 None] Group tempest-GroupsV320Test-Group-2104016380: creating Apr 29 08:58:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:58 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-66c1ae50-97a5-4397-85a1-0ba68086a14c tempest-GroupsV320Test-734524530 None] Group tempest-GroupsV320Test-Group-2104016380: created successfully Apr 29 08:58:58 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f Apr 29 08:58:58 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:58 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-66c1ae50-97a5-4397-85a1-0ba68086a14c tempest-GroupsV320Test-734524530 None] Create group completed successfully. Apr 29 08:58:58 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 29 08:58:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f" returned: 0 in 0.663s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:58:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:58:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a60aa5-0d16-46b5-836a-778f9f5b5ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e636a18-0f57-46d6-a086-28180baabbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:58:58 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Volume volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f (d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f): created successfully Apr 29 08:58:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e636a18-0f57-46d6-a086-28180baabbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:58:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Flow 'volume_create_manager' (181616e3-f0bb-4c57-9d72-2cf9e32615fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:58:58 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-04adb6eb-bc04-4b78-9414-eb2058a54710 tempest-VolumesListAdminTestJSON-1207115953 None] Created volume successfully. Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Acquiring lock "cinder-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Lock "cinder-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:59 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:58:59 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Acquiring lock "cinder-quobyte-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Lock "cinder-quobyte-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f" acquired by "delete_volume" :: waited 0.044s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "cinder-053e3915-3106-40b3-b4de-e8cd3c9df7b6-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb56d104-45a0-4b7e-8f56-d3bf88daf265]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Lock "cinder-053e3915-3106-40b3-b4de-e8cd3c9df7b6-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "cinder-quobyte-053e3915-3106-40b3-b4de-e8cd3c9df7b6" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Lock "cinder-quobyte-053e3915-3106-40b3-b4de-e8cd3c9df7b6" acquired by "delete_volume" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b51c8a6-34ff-4d5c-853c-e1fce6ae51fe]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:58:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:58:59 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f Apr 29 08:58:59 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:00 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-118132f7-70e9-462b-9a86-ed9b19369678 tempest-GroupsV320Test-734524530 None] Created reservations ['c9b94661-2a76-4895-8b05-55e53b82998c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:00 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6 Apr 29 08:59:00 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-118132f7-70e9-462b-9a86-ed9b19369678 tempest-GroupsV320Test-734524530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-118132f7-70e9-462b-9a86-ed9b19369678 tempest-GroupsV320Test-734524530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-118132f7-70e9-462b-9a86-ed9b19369678 tempest-GroupsV320Test-734524530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-118132f7-70e9-462b-9a86-ed9b19369678 tempest-GroupsV320Test-734524530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-118132f7-70e9-462b-9a86-ed9b19369678 tempest-GroupsV320Test-734524530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-118132f7-70e9-462b-9a86-ed9b19369678 tempest-GroupsV320Test-734524530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:00 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:59:00 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:00 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.256s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:59:01 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6" returned: 0 in 1.701s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:01 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6 Apr 29 08:59:01 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f" returned: 0 in 1.987s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:01 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:01 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-118132f7-70e9-462b-9a86-ed9b19369678 tempest-GroupsV320Test-734524530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.395s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:01 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-118132f7-70e9-462b-9a86-ed9b19369678 tempest-GroupsV320Test-734524530 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:59:01 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-118132f7-70e9-462b-9a86-ed9b19369678 tempest-GroupsV320Test-734524530 None] Delete group completed successfully. Apr 29 08:59:01 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f Apr 29 08:59:01 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:02 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-053e3915-3106-40b3-b4de-e8cd3c9df7b6" returned: 0 in 1.115s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Lock "cinder-quobyte-053e3915-3106-40b3-b4de-e8cd3c9df7b6" released by "delete_volume" :: held 2.905s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Created reservations ['860613ca-11a5-4711-967b-a65aac190319', '5062fb91-0907-4dd0-83e6-357d007a264e', 'ea277bb5-cf0c-4a8b-a29f-3a3f5dabef2c', '2d030cbd-390d-41cf-8374-bb2f90b7a662'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:03 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:59:03 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:03 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f" returned: 0 in 1.831s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Lock "cinder-quobyte-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f" released by "delete_volume" :: held 3.955s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "cinder-44a722d1-a28c-4c2d-9b36-d85f0365de82-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Flow 'volume_create_manager' (7f56f74d-2603-4258-9b7b-1ae9aa4dae23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e220183-4cb1-4179-96a3-81338c1e8603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Lock "cinder-44a722d1-a28c-4c2d-9b36-d85f0365de82-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e220183-4cb1-4179-96a3-81338c1e8603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:59:03Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77844384-edbd-4aa3-b71a-a07e4282f45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a058acfd664eb8a5b7b950654b051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:04Z,use_quota=True,user_id='23dd7129654d489c9961062ea45d3615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9925f8ad-ed1d-4a5b-b7a7-3f24b0c7cde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9925f8ad-ed1d-4a5b-b7a7-3f24b0c7cde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c381a23-cb0a-4d5f-9855-4cb962d5cb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.image.glance [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Creating Keystone auth plugin from conf {{(pid=83712) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Created reservations ['74fe94a2-b44d-43d8-9e1c-17ee29c14556', '2692a26e-a8eb-48bd-9e35-620f4762186c', '2a50c4b6-9897-420d-b6b7-f6436c3bb6a5', 'e9f79d7b-0f20-4d2d-b4ea-be16b9c48e83'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "cinder-quobyte-44a722d1-a28c-4c2d-9b36-d85f0365de82" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Lock "cinder-quobyte-44a722d1-a28c-4c2d-9b36-d85f0365de82" acquired by "delete_volume" :: waited 0.034s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62ceb2c-345b-43d6-b447-166643211ccd]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-44a722d1-a28c-4c2d-9b36-d85f0365de82 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:04 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:59:04 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:04 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-44a722d1-a28c-4c2d-9b36-d85f0365de82 Apr 29 08:59:04 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:04 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.577s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:04 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:59:04 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Deleted volume successfully. Apr 29 08:59:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-184f1819-f35b-4df6-8c4f-e5768cf3b962 tempest-VolumesListAdminTestJSON-573977379 None] Lock "cinder-053e3915-3106-40b3-b4de-e8cd3c9df7b6-delete_volume" released by "delete_volume" :: held 4.986s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c381a23-cb0a-4d5f-9855-4cb962d5cb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77844384-edbd-4aa3-b71a-a07e4282f45e', 'volume_name': 'volume-77844384-edbd-4aa3-b71a-a07e4282f45e', 'volume_size': 1, 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '858a6a572bfe4bfbb235aa79c8ac3e8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'created_at': datetime.datetime(2026, 4, 29, 6, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cdbedd-2479-4020-8356-7048aa471c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cdbedd-2479-4020-8356-7048aa471c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa950354-9827-4ada-8c0e-207f12f965f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:05 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Volume 77844384-edbd-4aa3-b71a-a07e4282f45e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77844384-edbd-4aa3-b71a-a07e4282f45e', 'volume_size': 1, 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '858a6a572bfe4bfbb235aa79c8ac3e8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'created_at': datetime.datetime(2026, 4, 29, 6, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 08:59:05 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Trying to clone 77844384-edbd-4aa3-b71a-a07e4282f45e from image 34fc92fe-7bdb-4c18-872f-7ff972aac86b at location (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]). {{(pid=83712) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 08:59:05 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-44a722d1-a28c-4c2d-9b36-d85f0365de82" returned: 0 in 1.385s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-44a722d1-a28c-4c2d-9b36-d85f0365de82 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:05 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-44a722d1-a28c-4c2d-9b36-d85f0365de82 Apr 29 08:59:05 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:05 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.354s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:05 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:59:05 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Deleted volume successfully. Apr 29 08:59:05 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-217f180b-41d7-4105-b080-b96fcdc5d0e7 tempest-VolumesListAdminTestJSON-1207115953 None] Lock "cinder-d8dd7d11-e5e9-4198-a418-eeaa8ea2b28f-delete_volume" released by "delete_volume" :: held 6.050s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:06 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83712) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 08:59:06 devstack cinder-volume[83712]: INFO cinder.image.image_utils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Image download 20.69 MB at 20.69 MB/s Apr 29 08:59:06 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2caf6fd-fff0-411b-bbb2-f845793fb855]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:06 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD Apr 29 08:59:06 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:06 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-44a722d1-a28c-4c2d-9b36-d85f0365de82" returned: 0 in 1.031s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Lock "cinder-quobyte-44a722d1-a28c-4c2d-9b36-d85f0365de82" released by "delete_volume" :: held 2.508s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:06 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Created reservations ['fdcdd4b3-e7ed-4c90-bdde-32ff1657d217', '6ffb436e-b350-41b9-a21f-0082134a3206', 'bcbaf84a-c9f0-45dc-80cc-ef717adfe179', '4f4b33bd-2043-40f5-9f0f-46514c090469'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:06 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:59:06 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:06 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d34c873c-53ec-4ec5-b282-7f9f2aa3ad35 tempest-GroupSnapshotsTest-1688921557 None] Group tempest-GroupSnapshotsTest-Group-670856079: creating Apr 29 08:59:06 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d34c873c-53ec-4ec5-b282-7f9f2aa3ad35 tempest-GroupSnapshotsTest-1688921557 None] Group tempest-GroupSnapshotsTest-Group-670856079: created successfully Apr 29 08:59:06 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d34c873c-53ec-4ec5-b282-7f9f2aa3ad35 tempest-GroupSnapshotsTest-1688921557 None] Create group completed successfully. Apr 29 08:59:07 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD" returned: 0 in 1.032s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Temporary image 34fc92fe-7bdb-4c18-872f-7ff972aac86b is fetched for user 23dd7129654d489c9961062ea45d3615. {{(pid=83712) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d266d0-fa01-4504-96d1-4529f5a918d1]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "cinder-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Lock "cinder-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "cinder-quobyte-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Lock "cinder-quobyte-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d" acquired by "delete_volume" :: waited 0.038s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:07 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD Apr 29 08:59:07 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[512f42fa-d678-46d6-8331-014b45b9bb07]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:07 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d Apr 29 08:59:07 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:07 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.001s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:59:07 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Deleted volume successfully. Apr 29 08:59:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-40239ebb-9340-4087-8b5c-bfec90995085 tempest-VolumesListAdminTestJSON-573977379 None] Lock "cinder-44a722d1-a28c-4c2d-9b36-d85f0365de82-delete_volume" released by "delete_volume" :: held 4.001s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:08 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD" returned: 0 in 0.923s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:59:03Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77844384-edbd-4aa3-b71a-a07e4282f45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a058acfd664eb8a5b7b950654b051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:04Z,use_quota=True,user_id='23dd7129654d489c9961062ea45d3615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Creating volume 77844384-edbd-4aa3-b71a-a07e4282f45e {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:59:08 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:08 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e 1073741824 Apr 29 08:59:08 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:08 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d" returned: 0 in 0.920s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:08 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d Apr 29 08:59:08 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Flow 'volume_create_manager' (ba04d3f2-3dee-446c-ab6a-ab8b33078221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1d21dd-5667-4df4-8c5b-0759ae38df64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1d21dd-5667-4df4-8c5b-0759ae38df64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-758478142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94beb988-d5a9-450e-8fa3-14c6080afade,host='devstack@QuobyteHD#QuobyteHD',id=db4d524b-2da3-4af4-b08f-13e46f25ff34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9eecf18c6426d84dac36841b71f85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:09Z,use_quota=True,user_id='791e33514d7847968e3fa69b7f2cfc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2855cc9-037a-46b1-92d0-902380ae0324),volume_type_id=a2855cc9-037a-46b1-92d0-902380ae0324)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac3f040-d7e5-4c47-b427-2b775452ffaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac3f040-d7e5-4c47-b427-2b775452ffaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ac35ab-7885-4de9-88c1-bd9782fb3460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ac35ab-7885-4de9-88c1-bd9782fb3460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db4d524b-2da3-4af4-b08f-13e46f25ff34', 'volume_name': 'volume-db4d524b-2da3-4af4-b08f-13e46f25ff34', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec12792-f44a-49c2-9246-ef6bb493ce16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec12792-f44a-49c2-9246-ef6bb493ce16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec334b9-a7ba-4f85-8a76-ed76eb465f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:08 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Volume db4d524b-2da3-4af4-b08f-13e46f25ff34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db4d524b-2da3-4af4-b08f-13e46f25ff34', 'volume_size': 1} Apr 29 08:59:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:09 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d" returned: 0 in 0.677s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Lock "cinder-quobyte-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d" released by "delete_volume" :: held 1.661s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:09 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Created reservations ['d0eb23e2-958c-4ea3-8b5d-8dd2009a4130', '2db40003-3778-4a61-ae43-b30fe26a4044', '8dd7247d-0d1d-4f67-8197-0086686a2253', 'e4fd8a28-d913-419b-ab18-697e4aade7f3'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:09 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:59:09 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:09 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e 1073741824" returned: 0 in 1.100s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:09 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e Apr 29 08:59:09 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:10 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.713s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:59:10 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Deleted volume successfully. Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1c349422-4290-4664-a48e-b12d2b8ed77e tempest-VolumesListAdminTestJSON-573977379 None] Lock "cinder-ff5ab9f7-15b0-4d1b-bb49-3746a2fffb7d-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:10 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e" returned: 0 in 0.735s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.400s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94beb988-d5a9-450e-8fa3-14c6080afade,created_at=2026-04-29T06:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-758478142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94beb988-d5a9-450e-8fa3-14c6080afade,host='devstack@QuobyteHD#QuobyteHD',id=db4d524b-2da3-4af4-b08f-13e46f25ff34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9eecf18c6426d84dac36841b71f85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:09Z,use_quota=True,user_id='791e33514d7847968e3fa69b7f2cfc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2855cc9-037a-46b1-92d0-902380ae0324),volume_type_id=a2855cc9-037a-46b1-92d0-902380ae0324)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Creating volume db4d524b-2da3-4af4-b08f-13e46f25ff34 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:59:10 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:10 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 1073741824 Apr 29 08:59:10 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG cinder.volume.volume_utils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Attempting download of 34fc92fe-7bdb-4c18-872f-7ff972aac86b ((None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}])) to volume 77844384-edbd-4aa3-b71a-a07e4282f45e. {{(pid=83712) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b29e55f-24d0-44c0-b2c1-bf1d2331df46]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_2ttaxokr {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:10 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_2ttaxokr Apr 29 08:59:10 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:11 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 1073741824" returned: 0 in 0.985s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:11 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 Apr 29 08:59:11 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:11 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_2ttaxokr" returned: 0 in 0.971s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_2ttaxokr {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:11 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_2ttaxokr Apr 29 08:59:11 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:12 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34" returned: 0 in 0.959s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:59:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec334b9-a7ba-4f85-8a76-ed76eb465f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4d524b-2da3-4af4-b08f-13e46f25ff34', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db100b9-84d0-4b42-b007-d24c610c2c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:12 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Volume volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 (db4d524b-2da3-4af4-b08f-13e46f25ff34): created successfully Apr 29 08:59:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db100b9-84d0-4b42-b007-d24c610c2c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Flow 'volume_create_manager' (ba04d3f2-3dee-446c-ab6a-ab8b33078221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:12 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-2bc9af6d-149a-43e8-acbe-2e40d32a4ddd tempest-GroupSnapshotsTest-1688921557 None] Created volume successfully. Apr 29 08:59:12 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_2ttaxokr" returned: 1 in 1.119s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_2ttaxokr' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 08:59:12 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd347a45-c66c-4bec-ac7e-1e4d1d9b1b7c]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:12 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD Apr 29 08:59:12 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:13 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:13 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] 34fc92fe-7bdb-4c18-872f-7ff972aac86b was qcow2, converting to raw {{(pid=83712) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 08:59:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:13 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e Apr 29 08:59:13 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:13 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] GroupSnapshot 2dd435a3-27da-4b9f-b7b0-c650e75f0e64: creating. Apr 29 08:59:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] Group snapshot 2dd435a3-27da-4b9f-b7b0-c650e75f0e64: creating. {{(pid=83712) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 08:59:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] Creating offline snapshot 69558936-3131-471a-be61-a91271887cbc of volume db4d524b-2da3-4af4-b08f-13e46f25ff34 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 08:59:13 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bbb2db-ed23-4908-a231-9273e9958dd7]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:13 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 Apr 29 08:59:13 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:14 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34" returned: 0 in 0.905s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:14 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc 1G Apr 29 08:59:14 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:15 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc 1G" returned: 0 in 1.119s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:15 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc Apr 29 08:59:15 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:15 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e" returned: 0 in 2.650s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:15 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_04za4c1ndevstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 08:59:15 devstack cinder-volume[83712]: INFO cinder.image.image_utils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Converted 112.00 MB image at 42.24 MB/s Apr 29 08:59:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:15 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e 1G Apr 29 08:59:15 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Flow 'volume_create_manager' (ffa2e483-544e-4ac8-a6a8-a6ef50f6bd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2048be57-f8ee-42a5-a319-cd15a7b3cce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2048be57-f8ee-42a5-a319-cd15a7b3cce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-202389035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03a9286-2a13-4582-b8bf-1fbfde7975c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def8c28171914035af62b3dd230bc718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:16Z,use_quota=True,user_id='77c6418ba70142b5b202e796486e3ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e177b9e0-58f8-4193-bdd1-018c3a61d370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e177b9e0-58f8-4193-bdd1-018c3a61d370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1757fa-0509-43a9-98ca-47d8e1bdb401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.image.glance [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Creating Keystone auth plugin from conf {{(pid=83712) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 08:59:16 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc" returned: 0 in 0.906s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:16 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc is being set with open permissions: ugo+rw: NotImplementedError Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:16 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc Apr 29 08:59:16 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1757fa-0509-43a9-98ca-47d8e1bdb401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e03a9286-2a13-4582-b8bf-1fbfde7975c4', 'volume_name': 'volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4', 'volume_size': 1, 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '858a6a572bfe4bfbb235aa79c8ac3e8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'created_at': datetime.datetime(2026, 4, 29, 6, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b0c5c7-6001-4b94-bded-092743cb50cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b0c5c7-6001-4b94-bded-092743cb50cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc16a26-9baa-41ed-b810-4d5fa44a1671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:16 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Volume e03a9286-2a13-4582-b8bf-1fbfde7975c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4', 'volume_size': 1, 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '858a6a572bfe4bfbb235aa79c8ac3e8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'created_at': datetime.datetime(2026, 4, 29, 6, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Trying to clone e03a9286-2a13-4582-b8bf-1fbfde7975c4 from image 34fc92fe-7bdb-4c18-872f-7ff972aac86b at location (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]). {{(pid=83712) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 08:59:16 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e 1G" returned: 0 in 0.977s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4334ae-36df-4e3c-94ce-6995e11d6f0b]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:17 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e Apr 29 08:59:17 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Flow 'volume_create_manager' (6e6345ec-2b35-48cd-ac17-fa0a62b45659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e961f8-cfb8-432c-acc1-9ea630372253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e961f8-cfb8-432c-acc1-9ea630372253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-818867365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d8aef3-69ac-4540-afde-c2228138f24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c875031c69f449a4886955eb3c34cd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:17Z,use_quota=True,user_id='b621d762eba44c3e9b026e8a9cc62663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca1952b-e286-4953-8c87-4b6c40ec7101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca1952b-e286-4953-8c87-4b6c40ec7101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacbb6d1-38ac-4c8d-81df-cb9058efa459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacbb6d1-38ac-4c8d-81df-cb9058efa459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d8aef3-69ac-4540-afde-c2228138f24b', 'volume_name': 'volume-40d8aef3-69ac-4540-afde-c2228138f24b', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9de4067-d735-44e6-9ba1-fdfa2b76627a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9de4067-d735-44e6-9ba1-fdfa2b76627a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c530c81-2a21-4435-b043-5a7c5650d6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:17 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Volume 40d8aef3-69ac-4540-afde-c2228138f24b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d8aef3-69ac-4540-afde-c2228138f24b', 'volume_size': 1} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83712) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 08:59:17 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Image download 20.69 MB at 20.69 MB/s Apr 29 08:59:17 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc" returned: 0 in 0.911s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3ae334-007a-4e2c-bf77-87ce78dcdd0c]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:17 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.info Apr 29 08:59:17 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:17 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD Apr 29 08:59:17 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:17 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e" returned: 0 in 0.887s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:17 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e Apr 29 08:59:17 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:18 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.info" returned: 0 in 0.671s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:18 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:18 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.info Apr 29 08:59:18 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:18 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD" returned: 0 in 0.756s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Temporary image 34fc92fe-7bdb-4c18-872f-7ff972aac86b is fetched for user 77c6418ba70142b5b202e796486e3ca2. {{(pid=83712) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bde7fc-73bc-457f-91ca-f60efac04f13]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:18 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD Apr 29 08:59:18 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:18 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e" returned: 1 in 0.800s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.volume_utils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Downloaded image 34fc92fe-7bdb-4c18-872f-7ff972aac86b ((None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}])) to volume 77844384-edbd-4aa3-b71a-a07e4282f45e successfully. {{(pid=83712) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Temporary image 34fc92fe-7bdb-4c18-872f-7ff972aac86b for user 23dd7129654d489c9961062ea45d3615 is deleted. {{(pid=83712) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.volume_utils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Marking volume 77844384-edbd-4aa3-b71a-a07e4282f45e as bootable. {{(pid=83712) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Copying metadata from image 34fc92fe-7bdb-4c18-872f-7ff972aac86b to 77844384-edbd-4aa3-b71a-a07e4282f45e. {{(pid=83712) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Creating volume glance metadata for volume 77844384-edbd-4aa3-b71a-a07e4282f45e backed by image 34fc92fe-7bdb-4c18-872f-7ff972aac86b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83712) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 08:59:18 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa950354-9827-4ada-8c0e-207f12f965f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77844384-edbd-4aa3-b71a-a07e4282f45e', 'volume_size': 1, 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '858a6a572bfe4bfbb235aa79c8ac3e8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'created_at': datetime.datetime(2026, 4, 29, 6, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5629696-ed94-4c62-9389-b07b7079f44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.info" returned: 0 in 0.647s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.301s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-818867365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d8aef3-69ac-4540-afde-c2228138f24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c875031c69f449a4886955eb3c34cd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:17Z,use_quota=True,user_id='b621d762eba44c3e9b026e8a9cc62663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Creating volume 40d8aef3-69ac-4540-afde-c2228138f24b {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:59:18 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40d8aef3-69ac-4540-afde-c2228138f24b 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:18 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Volume volume-77844384-edbd-4aa3-b71a-a07e4282f45e (77844384-edbd-4aa3-b71a-a07e4282f45e): created successfully Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5629696-ed94-4c62-9389-b07b7079f44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Flow 'volume_create_manager' (7f56f74d-2603-4258-9b7b-1ae9aa4dae23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:18 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40d8aef3-69ac-4540-afde-c2228138f24b 1073741824 Apr 29 08:59:18 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:18 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-6210f1c7-58e7-4c1d-adeb-cc4ce6388515 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Created volume successfully. Apr 29 08:59:18 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-1c421508-ac8d-43d6-9ab0-1d34a3104ef4 tempest-GroupSnapshotsTest-1688921557 None] group_snapshot 2dd435a3-27da-4b9f-b7b0-c650e75f0e64: created successfully Apr 29 08:59:19 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD" returned: 0 in 0.753s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-bf4f047c-1f14-4983-bfbc-63685a280cbf tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:19 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40d8aef3-69ac-4540-afde-c2228138f24b 1073741824" returned: 0 in 0.833s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40d8aef3-69ac-4540-afde-c2228138f24b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:19 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40d8aef3-69ac-4540-afde-c2228138f24b Apr 29 08:59:19 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:20 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40d8aef3-69ac-4540-afde-c2228138f24b" returned: 0 in 0.606s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.261s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-202389035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03a9286-2a13-4582-b8bf-1fbfde7975c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def8c28171914035af62b3dd230bc718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:16Z,use_quota=True,user_id='77c6418ba70142b5b202e796486e3ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Creating volume e03a9286-2a13-4582-b8bf-1fbfde7975c4 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:59:20 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c530c81-2a21-4435-b043-5a7c5650d6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d8aef3-69ac-4540-afde-c2228138f24b', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5310fcd1-1a5e-4715-85be-7155b8cdc8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:20 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 1073741824 Apr 29 08:59:20 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:20 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Volume volume-40d8aef3-69ac-4540-afde-c2228138f24b (40d8aef3-69ac-4540-afde-c2228138f24b): created successfully Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5310fcd1-1a5e-4715-85be-7155b8cdc8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Flow 'volume_create_manager' (6e6345ec-2b35-48cd-ac17-fa0a62b45659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:20 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-3abcd7ed-efa7-4400-b387-a5c122eccc87 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Created volume successfully. Apr 29 08:59:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:21 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 1073741824" returned: 0 in 0.832s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:21 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 Apr 29 08:59:21 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:21 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4" returned: 0 in 0.613s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:59:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-bf4f047c-1f14-4983-bfbc-63685a280cbf tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.192s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:21 devstack cinder-volume[83712]: DEBUG cinder.volume.volume_utils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Attempting download of 34fc92fe-7bdb-4c18-872f-7ff972aac86b ((None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}])) to volume e03a9286-2a13-4582-b8bf-1fbfde7975c4. {{(pid=83712) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 08:59:21 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa44e40-e2b3-4622-bce1-8078df7b1874]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-bf4f047c-1f14-4983-bfbc-63685a280cbf tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:21 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[24200174-afbc-4d15-bfc9-251cda2aaf74]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_3uho0es3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:21 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e Apr 29 08:59:21 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:22 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_3uho0es3 Apr 29 08:59:22 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Acquiring lock "cinder-40d8aef3-69ac-4540-afde-c2228138f24b-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Lock "cinder-40d8aef3-69ac-4540-afde-c2228138f24b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Acquiring lock "cinder-quobyte-40d8aef3-69ac-4540-afde-c2228138f24b" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Lock "cinder-quobyte-40d8aef3-69ac-4540-afde-c2228138f24b" acquired by "delete_volume" :: waited 0.028s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:22 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9b5c75-0f3f-4cb2-97c1-e988f8ca0fae]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40d8aef3-69ac-4540-afde-c2228138f24b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:22 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40d8aef3-69ac-4540-afde-c2228138f24b Apr 29 08:59:22 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:22 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-bf4f047c-1f14-4983-bfbc-63685a280cbf tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e" returned: 0 in 0.855s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-bf4f047c-1f14-4983-bfbc-63685a280cbf tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:22 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_3uho0es3" returned: 0 in 0.834s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_3uho0es3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:22 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e Apr 29 08:59:22 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:22 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_3uho0es3 Apr 29 08:59:22 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:23 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40d8aef3-69ac-4540-afde-c2228138f24b" returned: 0 in 0.791s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40d8aef3-69ac-4540-afde-c2228138f24b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:23 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40d8aef3-69ac-4540-afde-c2228138f24b Apr 29 08:59:23 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:23 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-bf4f047c-1f14-4983-bfbc-63685a280cbf tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e" returned: 1 in 0.796s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-bf4f047c-1f14-4983-bfbc-63685a280cbf tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-bf4f047c-1f14-4983-bfbc-63685a280cbf tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.701s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.572s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-69558936-3131-471a-be61-a91271887cbc-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" by "_create_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:23 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_3uho0es3" returned: 1 in 0.779s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_3uho0es3' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[818c93ea-4e6c-4c4c-8c1a-a15891d85f52]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-69558936-3131-471a-be61-a91271887cbc-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Creating volume 4f17a3ff-c76b-466f-b16f-ff9dd62d374e from snapshot 69558936-3131-471a-be61-a91271887cbc {{(pid=83712) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] snapshot: 69558936-3131-471a-be61-a91271887cbc, volume: 4f17a3ff-c76b-466f-b16f-ff9dd62d374e, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-bf4f047c-1f14-4983-bfbc-63685a280cbf tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa', 'name': 'volume-77844384-edbd-4aa3-b71a-a07e4282f45e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82345de8-ca05-4aa5-8b60-8a223d22acb3', 'enforce_multipath': True} {{(pid=83712) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3200f5-52e5-4901-ad3d-1a0e05c71a1c]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:23 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD Apr 29 08:59:23 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:23 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-4699dac7-dd3f-410a-afae-cfe206e0c6cc req-bf4f047c-1f14-4983-bfbc-63685a280cbf tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] attachment_update completed successfully. Apr 29 08:59:23 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc Apr 29 08:59:23 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:23 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40d8aef3-69ac-4540-afde-c2228138f24b" returned: 0 in 0.685s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Lock "cinder-quobyte-40d8aef3-69ac-4540-afde-c2228138f24b" released by "delete_volume" :: held 1.530s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:23 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Created reservations ['c1e79eab-9ba0-4a14-8645-9276f2158da2', 'c5d3be5e-d838-4b62-9ed9-fe263bcfaf6b', '3e7c7ac4-0f71-41bc-90f2-d8d9d78f3922', '5c7efb5e-015b-4add-92dc-23c31a77ad5a'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:24 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:59:24 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:24 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD" returned: 0 in 0.832s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] 34fc92fe-7bdb-4c18-872f-7ff972aac86b was qcow2, converting to raw {{(pid=83712) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:24 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 Apr 29 08:59:24 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:24 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc" returned: 0 in 0.907s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db4d524b-2da3-4af4-b08f-13e46f25ff34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[d584b688-00f9-4db0-a436-da1f9887591f]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:24 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 Apr 29 08:59:24 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:24 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.861s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:59:24 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Deleted volume successfully. Apr 29 08:59:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-088f5537-1fc0-4f35-a7d5-9484223b38c8 tempest-VolumeQuotasNegativeTestJSON-1699845989 None] Lock "cinder-40d8aef3-69ac-4540-afde-c2228138f24b-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:25 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34" returned: 0 in 1.190s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:25 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 08:59:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:25 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e Apr 29 08:59:25 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:27 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4" returned: 0 in 2.954s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:27 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_lcccjed5devstack@QuobyteHD, size 112.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 08:59:27 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Converted 112.00 MB image at 37.89 MB/s Apr 29 08:59:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:27 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 1G Apr 29 08:59:27 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:28 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 1G" returned: 0 in 1.580s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:29 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1205ea-5a9c-4d7b-a839-3220683b14a4]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:29 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 Apr 29 08:59:29 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:31 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4" returned: 0 in 2.315s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:31 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 Apr 29 08:59:31 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=69,cinder:UPDATE=70,cinder:DELETE=7,cinder:INSERT=24 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:59:34 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4" returned: 1 in 3.047s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG cinder.volume.volume_utils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Downloaded image 34fc92fe-7bdb-4c18-872f-7ff972aac86b ((None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}])) to volume e03a9286-2a13-4582-b8bf-1fbfde7975c4 successfully. {{(pid=83712) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Temporary image 34fc92fe-7bdb-4c18-872f-7ff972aac86b for user 77c6418ba70142b5b202e796486e3ca2 is deleted. {{(pid=83712) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG cinder.volume.volume_utils [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Marking volume e03a9286-2a13-4582-b8bf-1fbfde7975c4 as bootable. {{(pid=83712) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 08:59:34 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Copying metadata from image 34fc92fe-7bdb-4c18-872f-7ff972aac86b to e03a9286-2a13-4582-b8bf-1fbfde7975c4. {{(pid=83712) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Creating volume glance metadata for volume e03a9286-2a13-4582-b8bf-1fbfde7975c4 backed by image 34fc92fe-7bdb-4c18-872f-7ff972aac86b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83712) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" returned: 0 in 8.680s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5c285b-79ed-49bc-8fa7-20648ed41d80]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc16a26-9baa-41ed-b810-4d5fa44a1671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4', 'volume_size': 1, 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '858a6a572bfe4bfbb235aa79c8ac3e8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'created_at': datetime.datetime(2026, 4, 29, 6, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe7a099-ad5a-4738-981a-868cc6ef2f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:34 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Volume volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 (e03a9286-2a13-4582-b8bf-1fbfde7975c4): created successfully Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe7a099-ad5a-4738-981a-868cc6ef2f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Flow 'volume_create_manager' (ffa2e483-544e-4ac8-a6a8-a6ef50f6bd71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:34 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-07fbe2f8-ed17-4d30-bd0d-755b91ea6a9f tempest-VolumesImageMetadata-1860185060 None] Created volume successfully. Apr 29 08:59:34 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 Apr 29 08:59:34 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Acquiring lock "cinder-e03a9286-2a13-4582-b8bf-1fbfde7975c4-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Lock "cinder-e03a9286-2a13-4582-b8bf-1fbfde7975c4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:36 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=108,cinder:UPDATE=104,cinder:INSERT=33,cinder:DELETE=4 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 08:59:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Acquiring lock "cinder-quobyte-e03a9286-2a13-4582-b8bf-1fbfde7975c4" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Lock "cinder-quobyte-e03a9286-2a13-4582-b8bf-1fbfde7975c4" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:36 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[78118a18-7190-4fc5-ba83-040fec2d5031]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:36 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34" returned: 0 in 2.135s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:36 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34, size 1024.00 MB, duration 8.69 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 08:59:36 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Converted 1024.00 MB image at 117.90 MB/s Apr 29 08:59:36 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e is being set with open permissions: ugo+rw: NotImplementedError Apr 29 08:59:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:36 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e Apr 29 08:59:36 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:36 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 Apr 29 08:59:36 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:37 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4" returned: 0 in 1.322s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:37 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" returned: 0 in 1.230s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" released by "_copy_volume_from_snapshot" :: held 14.327s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-69558936-3131-471a-be61-a91271887cbc-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" released by "_create_volume_from_snapshot" :: held 14.387s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.431s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:37 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 Apr 29 08:59:37 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:38 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-92b9516d-08c9-4857-abb6-395169b3b199 tempest-GroupSnapshotsTest-1688921557 None] Create group from source-snapshot-2dd435a3-27da-4b9f-b7b0-c650e75f0e64 completed successfully. Apr 29 08:59:38 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4" returned: 1 in 1.035s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 08:59:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:38 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4 Apr 29 08:59:38 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" acquired by "delete_volume" :: waited 0.043s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:39 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ccc533-cf88-403c-b382-701275f7394a]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:39 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e Apr 29 08:59:39 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:39 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e03a9286-2a13-4582-b8bf-1fbfde7975c4" returned: 0 in 1.123s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Lock "cinder-quobyte-e03a9286-2a13-4582-b8bf-1fbfde7975c4" released by "delete_volume" :: held 3.596s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:40 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Created reservations ['9925af3e-6b67-42c8-b705-7a0a11086444', '1d836772-78c8-4576-b6b8-bf37cfdeee19', '9d61ef44-971e-4891-865e-b4e772fe3de6', '2ef642f4-98a1-435f-97a3-0c19eac4940b'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:40 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:59:40 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:40 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" returned: 0 in 1.299s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:41 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e Apr 29 08:59:41 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:41 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.578s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:41 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:59:41 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Deleted volume successfully. Apr 29 08:59:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e648fbd6-8079-4767-94a2-12e088409207 tempest-VolumesImageMetadata-1860185060 None] Lock "cinder-e03a9286-2a13-4582-b8bf-1fbfde7975c4-delete_volume" released by "delete_volume" :: held 5.610s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:42 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" returned: 0 in 1.373s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:42 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-4f17a3ff-c76b-466f-b16f-ff9dd62d374e" released by "delete_volume" :: held 2.766s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:42 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['612de0cb-f28f-4279-a9a7-42cb56f0e599'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:42 devstack cinder-volume[83712]: WARNING cinder.quota [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1375136630 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1375136630, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:59:42 devstack cinder-volume[83712]: WARNING cinder.quota [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1375136630 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1375136630, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:59:42 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['b7843175-8ba5-4d5f-935d-6c1071fd3b40', '5f360971-c7d3-4b15-85a5-58324b570a06', '832915cd-a8f9-4fa4-bfe7-b9d7d9b41742', '775503a5-3050-4a1d-a628-2466d015f734'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:42 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:59:42 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:43 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] group_snapshot 2dd435a3-27da-4b9f-b7b0-c650e75f0e64: deleting Apr 29 08:59:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] group_snapshot 2dd435a3-27da-4b9f-b7b0-c650e75f0e64: deleting {{(pid=83712) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 08:59:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-db4d524b-2da3-4af4-b08f-13e46f25ff34" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-db4d524b-2da3-4af4-b08f-13e46f25ff34" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-69558936-3131-471a-be61-a91271887cbc" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-69558936-3131-471a-be61-a91271887cbc" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Deleting offline snapshot 69558936-3131-471a-be61-a91271887cbc of volume db4d524b-2da3-4af4-b08f-13e46f25ff34 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 08:59:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] snapshot_file for this snap is: volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 08:59:43 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17cf177-4aee-49f7-89d7-945cfd421bc9]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:43 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc Apr 29 08:59:43 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:43 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.210s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:43 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:59:43 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d09a768c-ce57-4b7d-84e5-8d306cfe42f5 tempest-GroupSnapshotsTest-1688921557 None] Delete group completed successfully. Apr 29 08:59:44 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc" returned: 0 in 1.038s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db4d524b-2da3-4af4-b08f-13e46f25ff34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 08:59:44 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eb15c5-2041-4c8e-8387-5214c7903b83]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:44 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 Apr 29 08:59:44 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:45 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34" returned: 0 in 0.873s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:45 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc Apr 29 08:59:45 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:46 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc" returned: 0 in 0.801s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:46 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc Apr 29 08:59:46 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:47 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34.69558936-3131-471a-be61-a91271887cbc" returned: 0 in 0.739s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-69558936-3131-471a-be61-a91271887cbc" released by "_delete_snapshot" :: held 3.636s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-db4d524b-2da3-4af4-b08f-13e46f25ff34" released by "delete_snapshot" :: held 3.689s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:47 devstack cinder-volume[83712]: WARNING cinder.quota [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1375136630 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1375136630, it is now deprecated. Please use the default quota class for default quota. Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['de6216b4-96d3-4db1-b676-ed41dae481b1', '4ff67e0c-48e8-482a-a6c8-f11f649bf712', '25405c5e-2e64-4742-8372-c89e4fd19673', 'ccf72160-bee8-4599-92f1-d78a424cc823'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Flow 'volume_create_manager' (ea4c65a8-aa54-45a5-ae18-b57b408e1031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570c2264-4fdb-40f5-9567-5a2d39f44b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570c2264-4fdb-40f5-9567-5a2d39f44b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-679857647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f9bc92-63d3-4ca7-b3e1-85904d3b0db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36fb99ea62cf4c088e1d7fe71ac1965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:47Z,use_quota=True,user_id='c59a9d8da6a0461f9f60cfb75792103f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3043bb5-51f8-41fe-b6ad-6ebf0bcbc4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3043bb5-51f8-41fe-b6ad-6ebf0bcbc4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf79455-e4d3-4d34-8f17-b7c8bda7cb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf79455-e4d3-4d34-8f17-b7c8bda7cb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f9bc92-63d3-4ca7-b3e1-85904d3b0db3', 'volume_name': 'volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eeeeaa4-d7d9-45ce-b02c-145f607906c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eeeeaa4-d7d9-45ce-b02c-145f607906c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa131e9-d58d-4110-902f-ef352bdd8543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:47 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Volume 29f9bc92-63d3-4ca7-b3e1-85904d3b0db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3', 'volume_size': 1} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-679857647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f9bc92-63d3-4ca7-b3e1-85904d3b0db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36fb99ea62cf4c088e1d7fe71ac1965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:47Z,use_quota=True,user_id='c59a9d8da6a0461f9f60cfb75792103f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Creating volume 29f9bc92-63d3-4ca7-b3e1-85904d3b0db3 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:59:47 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:59:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:47 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3 1073741824 Apr 29 08:59:47 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:47 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d7e0cfbf-b4ac-4878-b53b-1ebe7af5a6c3 tempest-GroupSnapshotsTest-1688921557 None] group_snapshot 2dd435a3-27da-4b9f-b7b0-c650e75f0e64: deleted successfully Apr 29 08:59:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-db4d524b-2da3-4af4-b08f-13e46f25ff34" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-db4d524b-2da3-4af4-b08f-13e46f25ff34" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:48 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[135a84a6-5485-4a91-a0a0-f8c8caf5e3b3]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:48 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 Apr 29 08:59:48 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:48 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3 1073741824" returned: 0 in 1.069s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:48 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3 Apr 29 08:59:48 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:49 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3" returned: 0 in 1.008s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:49 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:59:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:49 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa131e9-d58d-4110-902f-ef352bdd8543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:49 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d957c44-9e56-4932-8d88-af4304e44e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:49 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34" returned: 0 in 1.375s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:49 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Volume volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3 (29f9bc92-63d3-4ca7-b3e1-85904d3b0db3): created successfully Apr 29 08:59:49 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d957c44-9e56-4932-8d88-af4304e44e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:49 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Flow 'volume_create_manager' (ea4c65a8-aa54-45a5-ae18-b57b408e1031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:49 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34 Apr 29 08:59:49 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:49 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-df99a8a0-14ab-45c0-8ec7-234061a410d1 tempest-AbsoluteLimitsTests-1499020389 None] Created volume successfully. Apr 29 08:59:50 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-db4d524b-2da3-4af4-b08f-13e46f25ff34" returned: 0 in 0.830s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-db4d524b-2da3-4af4-b08f-13e46f25ff34" released by "delete_volume" :: held 2.314s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['b71907ef-057e-47c1-a578-331afc357408'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:50 devstack cinder-volume[83712]: WARNING cinder.db.sqlalchemy.api [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1375136630'] Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['fb34bed6-0066-4faa-abb3-8f25f59284ff', '314cea67-8c6b-4fcb-80dd-0d8e4300e354', '075ff64d-f1c6-4412-8636-710d9505bb8c', 'a944b419-1e00-40f4-9588-39b3a7305f34'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:50 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:59:50 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Acquiring lock "cinder-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Lock "cinder-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Acquiring lock "cinder-quobyte-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 08:59:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Lock "cinder-quobyte-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3" acquired by "delete_volume" :: waited 0.032s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 08:59:51 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dec5c6-31cd-4b50-b2f9-a528bbbc254b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 08:59:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:51 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3 Apr 29 08:59:51 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:52 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.543s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:52 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:59:52 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f4ed681f-9f27-43ad-90fe-313b1623a323 tempest-GroupSnapshotsTest-1688921557 None] Delete group completed successfully. Apr 29 08:59:52 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3" returned: 0 in 1.584s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:52 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3 Apr 29 08:59:52 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:52 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-bfd7d3cc-4226-421f-a60a-a9a819968523 tempest-GroupSnapshotsTest-1688921557 None] Group tempest-GroupSnapshotsTest-Group-1588336371: creating Apr 29 08:59:52 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-bfd7d3cc-4226-421f-a60a-a9a819968523 tempest-GroupSnapshotsTest-1688921557 None] Group tempest-GroupSnapshotsTest-Group-1588336371: created successfully Apr 29 08:59:52 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-bfd7d3cc-4226-421f-a60a-a9a819968523 tempest-GroupSnapshotsTest-1688921557 None] Create group completed successfully. Apr 29 08:59:53 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3" returned: 0 in 1.045s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Lock "cinder-quobyte-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3" released by "delete_volume" :: held 2.719s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:53 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Created reservations ['6a8742a9-d34b-4686-a127-010b7378d9c4', '8c801605-759f-4d9b-80b3-49dff5089ffd', 'abe1bf02-4b31-46b0-ac39-3d38d40495e9', '514dd484-135a-4d43-8b4f-1788273b6129'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 08:59:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:53 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:53 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:53 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:59:53 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Flow 'volume_create_manager' (cad4c493-1040-48ce-a3c0-9e0e85681933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:54 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2178212b-ca6a-4652-b8d5-7eee097cb4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.925s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 08:59:54 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Deleted volume successfully. Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2178212b-ca6a-4652-b8d5-7eee097cb4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1984494514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73e8c801-ffeb-43c1-84ba-509b0fd63ecc,host='devstack@QuobyteHD#QuobyteHD',id=88ae88df-e26b-4870-ac11-84a663c6e733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9eecf18c6426d84dac36841b71f85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:55Z,use_quota=True,user_id='791e33514d7847968e3fa69b7f2cfc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09fcd02a-5b23-4f5e-b199-3a1d5104c350),volume_type_id=09fcd02a-5b23-4f5e-b199-3a1d5104c350)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f3196b-9101-4c4c-8f61-ae03a73acaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f3196b-9101-4c4c-8f61-ae03a73acaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9715401-b82f-471e-b8e6-911b83fa34c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9715401-b82f-471e-b8e6-911b83fa34c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ae88df-e26b-4870-ac11-84a663c6e733', 'volume_name': 'volume-88ae88df-e26b-4870-ac11-84a663c6e733', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0923fde-424f-46b2-aabb-965f26926247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0923fde-424f-46b2-aabb-965f26926247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02534ca4-c44f-40d2-9c04-ad9f3ce5aa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:54 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Volume 88ae88df-e26b-4870-ac11-84a663c6e733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ae88df-e26b-4870-ac11-84a663c6e733', 'volume_size': 1} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73e8c801-ffeb-43c1-84ba-509b0fd63ecc,created_at=2026-04-29T06:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1984494514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73e8c801-ffeb-43c1-84ba-509b0fd63ecc,host='devstack@QuobyteHD#QuobyteHD',id=88ae88df-e26b-4870-ac11-84a663c6e733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9eecf18c6426d84dac36841b71f85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:55Z,use_quota=True,user_id='791e33514d7847968e3fa69b7f2cfc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09fcd02a-5b23-4f5e-b199-3a1d5104c350),volume_type_id=09fcd02a-5b23-4f5e-b199-3a1d5104c350)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Creating volume 88ae88df-e26b-4870-ac11-84a663c6e733 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:59:54 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:59:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:55 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 1073741824 Apr 29 08:59:55 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:55 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b4447a1c-fb34-4119-9576-b2eb9307c069 tempest-AbsoluteLimitsTests-1499020389 None] Lock "cinder-29f9bc92-63d3-4ca7-b3e1-85904d3b0db3-delete_volume" released by "delete_volume" :: held 4.169s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 08:59:56 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 1073741824" returned: 0 in 1.417s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:56 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 Apr 29 08:59:56 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:57 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733" returned: 0 in 0.902s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] <== create_volume: return (2380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 08:59:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.384s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02534ca4-c44f-40d2-9c04-ad9f3ce5aa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ae88df-e26b-4870-ac11-84a663c6e733', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0ba495-2fb4-4232-896f-8ec8aa710ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:57 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Volume volume-88ae88df-e26b-4870-ac11-84a663c6e733 (88ae88df-e26b-4870-ac11-84a663c6e733): created successfully Apr 29 08:59:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0ba495-2fb4-4232-896f-8ec8aa710ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Flow 'volume_create_manager' (cad4c493-1040-48ce-a3c0-9e0e85681933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:57 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b3467367-7463-4feb-a536-a462532205af tempest-GroupSnapshotsTest-1688921557 None] Created volume successfully. Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Flow 'volume_create_manager' (2db1c506-f35f-4e00-9b66-fed8dd27e166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f31933b-34f1-4517-b422-08fcced92402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f31933b-34f1-4517-b422-08fcced92402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T06:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-753569554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73e8c801-ffeb-43c1-84ba-509b0fd63ecc,host='devstack@QuobyteHD#QuobyteHD',id=7356bdba-1e67-4d2f-83c4-e8d18e3f1616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9eecf18c6426d84dac36841b71f85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:59Z,use_quota=True,user_id='791e33514d7847968e3fa69b7f2cfc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09fcd02a-5b23-4f5e-b199-3a1d5104c350),volume_type_id=09fcd02a-5b23-4f5e-b199-3a1d5104c350)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03befaf-72b0-40a2-88e3-faad2b51c9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03befaf-72b0-40a2-88e3-faad2b51c9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47521138-c91c-4371-b061-ce23b20305ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47521138-c91c-4371-b061-ce23b20305ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7356bdba-1e67-4d2f-83c4-e8d18e3f1616', 'volume_name': 'volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9697f12a-6aca-4e99-b334-017f919102ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9697f12a-6aca-4e99-b334-017f919102ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d60a1c-c27f-45b8-bb18-b885edaaacf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 08:59:59 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Volume 7356bdba-1e67-4d2f-83c4-e8d18e3f1616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616', 'volume_size': 1} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73e8c801-ffeb-43c1-84ba-509b0fd63ecc,created_at=2026-04-29T06:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-753569554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73e8c801-ffeb-43c1-84ba-509b0fd63ecc,host='devstack@QuobyteHD#QuobyteHD',id=7356bdba-1e67-4d2f-83c4-e8d18e3f1616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9eecf18c6426d84dac36841b71f85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:59:59Z,use_quota=True,user_id='791e33514d7847968e3fa69b7f2cfc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09fcd02a-5b23-4f5e-b199-3a1d5104c350),volume_type_id=09fcd02a-5b23-4f5e-b199-3a1d5104c350)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Creating volume 7356bdba-1e67-4d2f-83c4-e8d18e3f1616 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 08:59:59 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:59 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 1073741824 Apr 29 08:59:59 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 08:59:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:59 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 08:59:59 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:00 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.379s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:00:00 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 1073741824" returned: 0 in 1.673s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:01 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 Apr 29 09:00:01 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:02 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616" returned: 0 in 1.395s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] <== create_volume: return (3155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:00:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.162s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d60a1c-c27f-45b8-bb18-b885edaaacf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3e3a0a-037b-4c35-8819-3434a005da83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:02 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Volume volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 (7356bdba-1e67-4d2f-83c4-e8d18e3f1616): created successfully Apr 29 09:00:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3e3a0a-037b-4c35-8819-3434a005da83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Flow 'volume_create_manager' (2db1c506-f35f-4e00-9b66-fed8dd27e166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:00:02 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8d439b03-c0f1-4291-8a1d-d53f8756a305 tempest-GroupSnapshotsTest-1688921557 None] Created volume successfully. Apr 29 09:00:04 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6d326cdc-45ba-4449-a041-52fef4bd38ad tempest-GroupSnapshotsTest-1688921557 None] Update group completed successfully. Apr 29 09:00:05 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e0873437-b58d-49a4-a3ab-f7e251ab135e tempest-GroupSnapshotsTest-1688921557 None] Update group completed successfully. Apr 29 09:00:06 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-e21bc126-e9be-4e65-ba10-18035e1bc1dc tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Terminate volume connection completed successfully. Apr 29 09:00:06 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-e21bc126-e9be-4e65-ba10-18035e1bc1dc tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Deleting attachment 82345de8-ca05-4aa5-8b60-8a223d22acb3. {{(pid=83712) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 09:00:06 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-22170571-f147-4d03-a1a2-bed0d5c99aec tempest-GroupSnapshotsTest-1688921557 None] Update group completed successfully. Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Acquiring lock "cinder-77844384-edbd-4aa3-b71a-a07e4282f45e-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "cinder-77844384-edbd-4aa3-b71a-a07e4282f45e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Acquiring lock "cinder-quobyte-77844384-edbd-4aa3-b71a-a07e4282f45e" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "cinder-quobyte-77844384-edbd-4aa3-b71a-a07e4282f45e" acquired by "delete_volume" :: waited 0.031s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2343941d-5409-4dfb-b765-a9b565677817]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:07 devstack sudo[88976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e Apr 29 09:00:07 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Flow 'volume_create_manager' (e2d475e1-2a0f-411d-9cba-fd19d3aa47e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22964444-0f6b-4d6d-9767-d135ea8771d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22964444-0f6b-4d6d-9767-d135ea8771d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1898331833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c7eebd-0b95-4f91-b4ea-b05719c060f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b193b83ab84d6c81f9222d716b3215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:00:08Z,use_quota=True,user_id='20bc99643737486580c061cf1b130e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c9938e-0cec-4133-8e12-440a193aeaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c9938e-0cec-4133-8e12-440a193aeaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26123a69-655d-403e-a89a-98f4255f342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26123a69-655d-403e-a89a-98f4255f342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9c7eebd-0b95-4f91-b4ea-b05719c060f3', 'volume_name': 'volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5c788a-7f75-4dd4-b68d-bf8ed9aa6eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5c788a-7f75-4dd4-b68d-bf8ed9aa6eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2882ddd-15c6-455d-b6a3-878e4ee3157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:07 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Volume e9c7eebd-0b95-4f91-b4ea-b05719c060f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3', 'volume_size': 1} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1898331833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c7eebd-0b95-4f91-b4ea-b05719c060f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b193b83ab84d6c81f9222d716b3215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:00:08Z,use_quota=True,user_id='20bc99643737486580c061cf1b130e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Creating volume e9c7eebd-0b95-4f91-b4ea-b05719c060f3 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:00:07 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:00:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:07 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3 1073741824 Apr 29 09:00:07 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:07 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a9c590a5-75cd-4f39-910f-2fb4b2a5b2db tempest-GroupSnapshotsTest-1688921557 None] Update group completed successfully. Apr 29 09:00:08 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e" returned: 0 in 0.956s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:08 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e Apr 29 09:00:08 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:08 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3 1073741824" returned: 0 in 1.193s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:08 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e" returned: 1 in 0.807s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:00:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:08 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e Apr 29 09:00:08 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:09 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3 Apr 29 09:00:09 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:09 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] GroupSnapshot 2e1ec4f0-0815-40b1-9067-1a5c314257a4: creating. Apr 29 09:00:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Group snapshot 2e1ec4f0-0815-40b1-9067-1a5c314257a4: creating. {{(pid=83712) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 09:00:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:09 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-77844384-edbd-4aa3-b71a-a07e4282f45e" returned: 0 in 0.993s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "cinder-quobyte-77844384-edbd-4aa3-b71a-a07e4282f45e" released by "delete_volume" :: held 2.887s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:10 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3" returned: 0 in 1.068s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] <== create_volume: return (2333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.340s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.291s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2882ddd-15c6-455d-b6a3-878e4ee3157b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9f9829-19d4-4194-a256-9ee8bade996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Creating offline snapshot a156d130-ecef-4865-8a03-416dc2a62132 of volume 88ae88df-e26b-4870-ac11-84a663c6e733 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:00:10 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Volume volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3 (e9c7eebd-0b95-4f91-b4ea-b05719c060f3): created successfully Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9f9829-19d4-4194-a256-9ee8bade996a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Flow 'volume_create_manager' (e2d475e1-2a0f-411d-9cba-fd19d3aa47e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dfe8a4-d2f7-41c9-9803-7e52ee635781]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:10 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a6b7485a-b7c0-414d-a37b-87690ce48cb6 tempest-VolumesNegativeTest-582836208 None] Created volume successfully. Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG cinder.quota [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Created reservations ['6f43c905-9510-4130-88bc-c0a3ac5c0591', '95b99126-0ccf-432f-bc23-8fb558e9d330', '539d31f6-1b48-40c0-8c2f-1efaf26f24f4', 'a5f3bef1-c268-4397-b151-001b98bc8efc'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:10 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:00:10 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:10 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:00:10 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:11 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:11 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733" returned: 0 in 1.156s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.967s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:11 devstack cinder-volume[83712]: DEBUG cinder.manager [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:00:11 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Deleted volume successfully. Apr 29 09:00:11 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 1G Apr 29 09:00:11 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-7c5b0752-2102-41a2-b5fb-662babe63c16 req-3653ba7b-8d94-4bb4-87a9-b8c556ebd67d tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "cinder-77844384-edbd-4aa3-b71a-a07e4282f45e-delete_volume" released by "delete_volume" :: held 4.294s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:12 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 1G" returned: 0 in 1.279s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88ae88df-e26b-4870-ac11-84a663c6e733 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:12 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88ae88df-e26b-4870-ac11-84a663c6e733 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 Apr 29 09:00:12 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:13 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88ae88df-e26b-4870-ac11-84a663c6e733 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132" returned: 0 in 0.904s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:13 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:00:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:13 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 Apr 29 09:00:13 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:14 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132" returned: 0 in 0.759s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:14 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.info Apr 29 09:00:14 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:15 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.info" returned: 0 in 0.775s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:15 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:00:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:15 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.info Apr 29 09:00:15 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:15 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.info" returned: 0 in 0.722s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.742s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Creating offline snapshot eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 of volume 7356bdba-1e67-4d2f-83c4-e8d18e3f1616 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:00:15 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[480cbf27-d27f-4a82-936b-f296f3dda4b8]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:15 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 Apr 29 09:00:15 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:16 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616" returned: 0 in 0.886s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:16 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 1G Apr 29 09:00:16 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:17 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 1G" returned: 0 in 1.023s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:17 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 Apr 29 09:00:17 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:18 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8" returned: 0 in 1.083s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:18 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:00:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:18 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 Apr 29 09:00:18 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:19 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8" returned: 0 in 0.738s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:19 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.info Apr 29 09:00:19 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:20 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.info" returned: 0 in 0.750s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:20 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:00:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:20 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.info Apr 29 09:00:20 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:21 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.info" returned: 0 in 0.705s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.299s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:21 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f5bc84c3-160f-48ef-b6b8-02944e3a1188 tempest-GroupSnapshotsTest-1688921557 None] group_snapshot 2e1ec4f0-0815-40b1-9067-1a5c314257a4: created successfully Apr 29 09:00:21 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] group_snapshot 2e1ec4f0-0815-40b1-9067-1a5c314257a4: deleting Apr 29 09:00:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] group_snapshot 2e1ec4f0-0815-40b1-9067-1a5c314257a4: deleting {{(pid=83712) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 09:00:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-88ae88df-e26b-4870-ac11-84a663c6e733" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-88ae88df-e26b-4870-ac11-84a663c6e733" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-a156d130-ecef-4865-8a03-416dc2a62132" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-a156d130-ecef-4865-8a03-416dc2a62132" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Deleting offline snapshot a156d130-ecef-4865-8a03-416dc2a62132 of volume 88ae88df-e26b-4870-ac11-84a663c6e733 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:00:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] snapshot_file for this snap is: volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:00:21 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a5e42c-fa02-4a77-a119-7ec656fd47a9]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:21 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 Apr 29 09:00:21 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:22 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132" returned: 0 in 0.965s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88ae88df-e26b-4870-ac11-84a663c6e733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:00:22 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38fc249-90db-4332-b482-080fb400c6ef]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:23 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 Apr 29 09:00:23 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733" returned: 0 in 0.813s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:23 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:23 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 Apr 29 09:00:23 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:24 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-5d9dd795-3217-40b4-bab0-f7aeffd357db tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Terminate volume connection completed successfully. Apr 29 09:00:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-5d9dd795-3217-40b4-bab0-f7aeffd357db tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Deleting attachment 4ce8d308-63ef-444d-b11c-8753ba0259f5. {{(pid=83712) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 09:00:24 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132" returned: 0 in 0.812s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:24 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132 Apr 29 09:00:24 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Acquiring lock "cinder-c75cefd3-fb4f-4c63-b770-620350aea392-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "cinder-c75cefd3-fb4f-4c63-b770-620350aea392-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Acquiring lock "cinder-quobyte-c75cefd3-fb4f-4c63-b770-620350aea392" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "cinder-quobyte-c75cefd3-fb4f-4c63-b770-620350aea392" acquired by "delete_volume" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:24 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c2b3fe-abe6-4dc0-9b8e-cf89c8cf6867]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:24 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392 Apr 29 09:00:24 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:25 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733.a156d130-ecef-4865-8a03-416dc2a62132" returned: 0 in 0.727s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-a156d130-ecef-4865-8a03-416dc2a62132" released by "_delete_snapshot" :: held 3.542s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-88ae88df-e26b-4870-ac11-84a663c6e733" released by "delete_snapshot" :: held 3.587s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-7356bdba-1e67-4d2f-83c4-e8d18e3f1616" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-7356bdba-1e67-4d2f-83c4-e8d18e3f1616" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Deleting offline snapshot eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 of volume 7356bdba-1e67-4d2f-83c4-e8d18e3f1616 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:00:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] snapshot_file for this snap is: volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:00:25 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8df5849-dc20-4040-be55-9fb445f22da1]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:25 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 Apr 29 09:00:25 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:26 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392" returned: 0 in 1.507s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:26 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392 Apr 29 09:00:26 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:27 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8" returned: 0 in 1.834s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[349c4954-6b2e-4708-bd7c-fc30245cf4b0]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:27 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c75cefd3-fb4f-4c63-b770-620350aea392" returned: 0 in 1.086s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "cinder-quobyte-c75cefd3-fb4f-4c63-b770-620350aea392" released by "delete_volume" :: held 2.647s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:27 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 Apr 29 09:00:27 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG cinder.quota [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Created reservations ['6da21b42-7cea-4d4f-b486-d67921d5bf07', '0990747d-6c60-4e9c-877f-6a2684405290', '91dbb138-a6c7-469c-ad1f-412aef2db3a5', '8b2d32f4-9a69-4c29-89e5-af4be08ccd24'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:27 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:00:27 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:28 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.912s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:28 devstack cinder-volume[83712]: DEBUG cinder.manager [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:00:28 devstack cinder-volume[83712]: INFO cinder.volume.manager [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Deleted volume successfully. Apr 29 09:00:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [req-521c9e7f-3005-4b52-9879-48263c49bd2f req-28b70ae4-a27b-4ccb-aeea-ce0f8ad24055 tempest-ServerBootFromVolumeStableRescueTest-1455155775 None] Lock "cinder-c75cefd3-fb4f-4c63-b770-620350aea392-delete_volume" released by "delete_volume" :: held 3.823s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:28 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616" returned: 0 in 1.406s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:28 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 Apr 29 09:00:28 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:29 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8" returned: 0 in 1.212s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:30 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8 Apr 29 09:00:30 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:31 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616.eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8" returned: 0 in 1.127s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-eed12ee1-f39e-4235-b1d5-b0e6fd00f9d8" released by "_delete_snapshot" :: held 5.832s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-7356bdba-1e67-4d2f-83c4-e8d18e3f1616" released by "delete_snapshot" :: held 5.889s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:31 devstack cinder-volume[83712]: WARNING cinder.quota [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-957361905 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-957361905, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:00:31 devstack cinder-volume[83712]: WARNING cinder.quota [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-957361905 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-957361905, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:00:31 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['5fa59bbd-aee4-4b8f-baf9-b6ba9a8cdf3c', '36f7d2b8-13d6-4c5b-a5e5-eb0e0a507f95', 'dfe90f06-1d40-4594-9d46-dbf6779e3b5e', '6a78a024-0def-4677-b7c0-45491fb01947'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:31 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['0c978136-f5d1-4882-b873-d6ed68cacba5', '2ff179a4-81e5-4d30-add3-eb635e50d21b', '288e1b65-9ead-434f-bce0-904544fb09f4', 'a234e17d-7bd1-4bd9-bd27-e4923b064314'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:31 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-648a7d09-370e-4b33-9c68-9d9445333a24 tempest-GroupSnapshotsTest-1688921557 None] group_snapshot 2e1ec4f0-0815-40b1-9067-1a5c314257a4: deleted successfully Apr 29 09:00:33 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-7356bdba-1e67-4d2f-83c4-e8d18e3f1616" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:33 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-7356bdba-1e67-4d2f-83c4-e8d18e3f1616" acquired by "delete_volume" :: waited 0.038s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:33 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[502548a2-4330-42f7-a181-91955b22c294]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:33 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 Apr 29 09:00:33 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:34 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616" returned: 0 in 1.319s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:34 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616 Apr 29 09:00:34 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:35 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7356bdba-1e67-4d2f-83c4-e8d18e3f1616" returned: 0 in 0.775s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-7356bdba-1e67-4d2f-83c4-e8d18e3f1616" released by "delete_volume" :: held 2.226s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-88ae88df-e26b-4870-ac11-84a663c6e733" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-88ae88df-e26b-4870-ac11-84a663c6e733" acquired by "delete_volume" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:35 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5044ab1-3d18-4d24-8daa-b7e5a853d84f]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:35 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 Apr 29 09:00:35 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:36 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733" returned: 0 in 0.819s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:36 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733 Apr 29 09:00:36 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:36 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:UPDATE=87,cinder:SELECT=84,cinder:INSERT=25,cinder:DELETE=4 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:00:36 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=99,cinder:INSERT=23,cinder:UPDATE=102,cinder:DELETE=5 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:00:37 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-88ae88df-e26b-4870-ac11-84a663c6e733" returned: 0 in 0.842s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-88ae88df-e26b-4870-ac11-84a663c6e733" released by "delete_volume" :: held 1.774s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['266ab969-707e-47c5-9646-9961e915feb8'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Flow 'volume_create_manager' (eabbe178-09be-461a-af62-cfd585b0ef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd9cf68-5679-4bf0-b38a-b09aeef04879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd9cf68-5679-4bf0-b38a-b09aeef04879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1517889392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe56e0b655e421bad52c1036c87716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:00:37Z,use_quota=True,user_id='8a3e1aa36b2849eaaf15e798943c774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53c3645-6a47-49c4-8f13-651672ef6f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53c3645-6a47-49c4-8f13-651672ef6f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e03e3ef-f323-4346-9ecd-60a23ebc1f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e03e3ef-f323-4346-9ecd-60a23ebc1f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59', 'volume_name': 'volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47638ab4-d4fd-4594-bba0-0d8b6225ad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47638ab4-d4fd-4594-bba0-0d8b6225ad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df91d8cc-3ae6-4f66-8d38-05d809d3850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:37 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Volume aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59', 'volume_size': 1} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1517889392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe56e0b655e421bad52c1036c87716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:00:37Z,use_quota=True,user_id='8a3e1aa36b2849eaaf15e798943c774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Creating volume aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:00:37 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:37 devstack cinder-volume[83712]: WARNING cinder.quota [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-957361905 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-957361905, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:00:37 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 1073741824 Apr 29 09:00:37 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['b907e46e-53de-4552-8901-b144b73a3d87', '504cbda7-1172-4f3a-bcb3-a75f34dc38d5', '234bcd55-478c-4309-aa29-0443b6d2f398', '076bbf0d-a422-4e2e-a464-38755cce038c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['f69b4ce8-765a-486c-997f-d29965201a1b', '4d02ebf3-9031-4d85-bb00-411ad52990fc', 'c27e4c22-2b3e-43cb-a63d-510a7a070cd6', 'b4b8204d-ad5a-4deb-a96b-b08c380ef140'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:37 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:00:37 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:38 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 1073741824" returned: 0 in 1.067s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:38 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 Apr 29 09:00:38 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:38 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.068s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:38 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:00:39 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f311e92f-c5af-4219-b8cb-61c2185af5f9 tempest-GroupSnapshotsTest-1688921557 None] Delete group completed successfully. Apr 29 09:00:39 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a8d30959-089e-4136-b9d9-a9064f90e69c tempest-GroupSnapshotsTest-1688921557 None] Group tempest-GroupSnapshotsTest-Group-1259831416: creating Apr 29 09:00:39 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a8d30959-089e-4136-b9d9-a9064f90e69c tempest-GroupSnapshotsTest-1688921557 None] Group tempest-GroupSnapshotsTest-Group-1259831416: created successfully Apr 29 09:00:39 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59" returned: 0 in 1.334s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] <== create_volume: return (2472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:00:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.476s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:39 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a8d30959-089e-4136-b9d9-a9064f90e69c tempest-GroupSnapshotsTest-1688921557 None] Create group completed successfully. Apr 29 09:00:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df91d8cc-3ae6-4f66-8d38-05d809d3850f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9392e6-b114-42bf-8263-b57b2a0e8a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:39 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Volume volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 (aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59): created successfully Apr 29 09:00:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9392e6-b114-42bf-8263-b57b2a0e8a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Flow 'volume_create_manager' (eabbe178-09be-461a-af62-cfd585b0ef1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:00:40 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-96cc941c-ecfd-458c-90a4-ce38f0552560 tempest-VolumesActionsTest-259837857 None] Created volume successfully. Apr 29 09:00:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-05f668bb-3bed-4f09-b36c-5fd834607561 tempest-VolumesActionsTest-259837857 None] Acquiring lock "cinder-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59" by "attach_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-05f668bb-3bed-4f09-b36c-5fd834607561 tempest-VolumesActionsTest-259837857 None] Lock "cinder-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59" acquired by "attach_volume" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:40 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-05f668bb-3bed-4f09-b36c-5fd834607561 tempest-VolumesActionsTest-259837857 None] Attaching volume aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 to instance 937f3f86-b7f6-45db-ab33-dbf1280b863e at mountpoint /dev/vdb on host None. Apr 29 09:00:40 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-05f668bb-3bed-4f09-b36c-5fd834607561 tempest-VolumesActionsTest-259837857 None] Attach volume completed successfully. Apr 29 09:00:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-05f668bb-3bed-4f09-b36c-5fd834607561 tempest-VolumesActionsTest-259837857 None] Lock "cinder-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59" released by "attach_volume" :: held 0.197s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:41 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-47a0bf1c-165a-4e6e-9612-582d640d2de4 tempest-VolumesActionsTest-1278016634 None] Terminate volume connection completed successfully. Apr 29 09:00:41 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Flow 'volume_create_manager' (e6c65e78-f2de-4a75-8ed3-f4a4e6ad6655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc10ac5-1ac0-4c31-abd2-6d9ded6b86ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc10ac5-1ac0-4c31-abd2-6d9ded6b86ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-492291111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7dab6341-2c4b-44be-ae3f-93ef8c0ad449,host='devstack@QuobyteHD#QuobyteHD',id=2329c631-35f0-445b-9663-356e2c9c8bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9eecf18c6426d84dac36841b71f85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:00:42Z,use_quota=True,user_id='791e33514d7847968e3fa69b7f2cfc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(773e0ec7-705e-4e54-a701-200c3b16d473),volume_type_id=773e0ec7-705e-4e54-a701-200c3b16d473)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a33d99-a643-4468-ba16-606e8f405f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a33d99-a643-4468-ba16-606e8f405f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4b5959-0e6f-45f6-91ba-73ec51758745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4b5959-0e6f-45f6-91ba-73ec51758745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2329c631-35f0-445b-9663-356e2c9c8bb0', 'volume_name': 'volume-2329c631-35f0-445b-9663-356e2c9c8bb0', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13fd151-8c04-4b1b-8ad8-33001defb497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13fd151-8c04-4b1b-8ad8-33001defb497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f76625-6ca1-41ce-99b2-da37c8d48e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:42 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Volume 2329c631-35f0-445b-9663-356e2c9c8bb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2329c631-35f0-445b-9663-356e2c9c8bb0', 'volume_size': 1} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7dab6341-2c4b-44be-ae3f-93ef8c0ad449,created_at=2026-04-29T07:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-492291111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7dab6341-2c4b-44be-ae3f-93ef8c0ad449,host='devstack@QuobyteHD#QuobyteHD',id=2329c631-35f0-445b-9663-356e2c9c8bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da9eecf18c6426d84dac36841b71f85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:00:42Z,use_quota=True,user_id='791e33514d7847968e3fa69b7f2cfc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(773e0ec7-705e-4e54-a701-200c3b16d473),volume_type_id=773e0ec7-705e-4e54-a701-200c3b16d473)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Creating volume 2329c631-35f0-445b-9663-356e2c9c8bb0 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:00:42 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:42 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 1073741824 Apr 29 09:00:42 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-47a0bf1c-165a-4e6e-9612-582d640d2de4 tempest-VolumesActionsTest-1278016634 None] Acquiring lock "cinder-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59-detach_volume" by "detach_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-47a0bf1c-165a-4e6e-9612-582d640d2de4 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:42 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-47a0bf1c-165a-4e6e-9612-582d640d2de4 tempest-VolumesActionsTest-1278016634 None] Detaching volume aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 from instance 937f3f86-b7f6-45db-ab33-dbf1280b863e. Apr 29 09:00:42 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-47a0bf1c-165a-4e6e-9612-582d640d2de4 tempest-VolumesActionsTest-1278016634 None] Detach volume completed successfully. Apr 29 09:00:42 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-47a0bf1c-165a-4e6e-9612-582d640d2de4 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59-detach_volume" released by "detach_volume" :: held 0.194s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c84e9773-9083-46d2-b619-61d5cb50c672 tempest-VolumesActionsTest-259837857 None] Acquiring lock "cinder-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59-detach_volume" by "detach_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c84e9773-9083-46d2-b619-61d5cb50c672 tempest-VolumesActionsTest-259837857 None] Lock "cinder-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:43 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c84e9773-9083-46d2-b619-61d5cb50c672 tempest-VolumesActionsTest-259837857 None] Volume detach called, but volume not attached. Apr 29 09:00:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c84e9773-9083-46d2-b619-61d5cb50c672 tempest-VolumesActionsTest-259837857 None] Lock "cinder-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:43 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 1073741824" returned: 0 in 1.591s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:43 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 Apr 29 09:00:43 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Acquiring lock "cinder-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Lock "cinder-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Acquiring lock "cinder-quobyte-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Lock "cinder-quobyte-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59" acquired by "delete_volume" :: waited 0.041s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:44 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a5fc6a-faf0-41c2-b940-548802edc841]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:44 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 Apr 29 09:00:44 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:44 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0" returned: 0 in 1.130s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] <== create_volume: return (2785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:00:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.791s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f76625-6ca1-41ce-99b2-da37c8d48e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2329c631-35f0-445b-9663-356e2c9c8bb0', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ff7ab3-73c0-466f-ab7a-2d08752a22ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:44 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Volume volume-2329c631-35f0-445b-9663-356e2c9c8bb0 (2329c631-35f0-445b-9663-356e2c9c8bb0): created successfully Apr 29 09:00:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ff7ab3-73c0-466f-ab7a-2d08752a22ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Flow 'volume_create_manager' (e6c65e78-f2de-4a75-8ed3-f4a4e6ad6655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:00:45 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8932ca62-8a2e-4611-9c6e-6dd46029a22c tempest-GroupSnapshotsTest-1688921557 None] Created volume successfully. Apr 29 09:00:45 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59" returned: 0 in 1.240s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:45 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59 Apr 29 09:00:45 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:45 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] GroupSnapshot e6ef16cb-5b3e-4134-b3a7-5d95906f3f2b: creating. Apr 29 09:00:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] Group snapshot e6ef16cb-5b3e-4134-b3a7-5d95906f3f2b: creating. {{(pid=83712) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 09:00:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] Creating offline snapshot 6d91320e-d4dc-4b15-85c6-6186eb83dfa8 of volume 2329c631-35f0-445b-9663-356e2c9c8bb0 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:00:46 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ebd612-e06d-41af-8dd1-30b7c6efaa86]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:46 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 Apr 29 09:00:46 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:47 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59" returned: 0 in 1.519s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:47 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0" returned: 0 in 1.121s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Lock "cinder-quobyte-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59" released by "delete_volume" :: held 2.896s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:47 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 1G Apr 29 09:00:47 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:47 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Created reservations ['6f1fa702-786b-4deb-b377-cfcfe533e184', '4343906e-3b48-4a24-803a-72c44dff8a0f', 'ac0f4884-4c54-4dba-9700-1cbc29ff4c91', '96de6490-c340-414b-a96b-dadc7bd5d8d3'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:00:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:00:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:47 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:00:47 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:48 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.819s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:48 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:00:48 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Deleted volume successfully. Apr 29 09:00:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a6ef87b9-474c-43ad-b58b-4a90038e9efb tempest-VolumesActionsTest-259837857 None] Lock "cinder-aaa210cb-75c9-4eb0-bcc6-f840e9fc9a59-delete_volume" released by "delete_volume" :: held 4.081s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:48 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 1G" returned: 0 in 1.100s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2329c631-35f0-445b-9663-356e2c9c8bb0 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:48 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2329c631-35f0-445b-9663-356e2c9c8bb0 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 Apr 29 09:00:48 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:49 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2329c631-35f0-445b-9663-356e2c9c8bb0 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8" returned: 0 in 0.966s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:49 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:00:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:49 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 Apr 29 09:00:49 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:50 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8" returned: 0 in 0.872s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:50 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.info Apr 29 09:00:50 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Acquiring lock "cinder-e9c7eebd-0b95-4f91-b4ea-b05719c060f3-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Lock "cinder-e9c7eebd-0b95-4f91-b4ea-b05719c060f3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Acquiring lock "cinder-quobyte-e9c7eebd-0b95-4f91-b4ea-b05719c060f3" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Lock "cinder-quobyte-e9c7eebd-0b95-4f91-b4ea-b05719c060f3" acquired by "delete_volume" :: waited 0.032s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:50 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e86d70-92a4-4586-b072-09330fdf7d8f]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:51 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3 Apr 29 09:00:51 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:51 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.info" returned: 0 in 0.977s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:51 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:00:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:51 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.info Apr 29 09:00:51 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:51 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.info" returned: 0 in 0.711s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:51 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.863s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3" returned: 0 in 0.952s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:51 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3 Apr 29 09:00:51 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:52 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-95321aa8-cac0-49f2-b8c1-2f264c7f254f tempest-GroupSnapshotsTest-1688921557 None] group_snapshot e6ef16cb-5b3e-4134-b3a7-5d95906f3f2b: created successfully Apr 29 09:00:52 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e9c7eebd-0b95-4f91-b4ea-b05719c060f3" returned: 0 in 0.755s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Lock "cinder-quobyte-e9c7eebd-0b95-4f91-b4ea-b05719c060f3" released by "delete_volume" :: held 1.773s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Created reservations ['eeb73680-c9d4-4dce-b8ec-8c00266c9aef', '1892b6c8-7946-4cef-baf5-c8de880ec8f5', '061f321b-b863-4ff3-9679-5e59a56fb513', '6cb2d2df-bb01-48c8-9dd2-059133fbc9f7'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:52 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] group_snapshot e6ef16cb-5b3e-4134-b3a7-5d95906f3f2b: deleting Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] group_snapshot e6ef16cb-5b3e-4134-b3a7-5d95906f3f2b: deleting {{(pid=83712) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-2329c631-35f0-445b-9663-356e2c9c8bb0" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:52 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:00:52 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-2329c631-35f0-445b-9663-356e2c9c8bb0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-6d91320e-d4dc-4b15-85c6-6186eb83dfa8" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-6d91320e-d4dc-4b15-85c6-6186eb83dfa8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Deleting offline snapshot 6d91320e-d4dc-4b15-85c6-6186eb83dfa8 of volume 2329c631-35f0-445b-9663-356e2c9c8bb0 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] snapshot_file for this snap is: volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2effb456-4a6b-4a69-bfbd-1443e074b8a0]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:53 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 Apr 29 09:00:53 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:53 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.869s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:53 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:00:53 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Deleted volume successfully. Apr 29 09:00:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b18fa477-298d-4958-8c21-5f181cf80a72 tempest-VolumesNegativeTest-582836208 None] Lock "cinder-e9c7eebd-0b95-4f91-b4ea-b05719c060f3-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:53 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8" returned: 0 in 0.919s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:53 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2329c631-35f0-445b-9663-356e2c9c8bb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:00:53 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1995cb-607c-43bb-bc10-f7bdd8c846f1]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:54 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 Apr 29 09:00:54 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:54 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0" returned: 0 in 0.894s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:54 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 Apr 29 09:00:54 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Flow 'volume_create_manager' (30ce1879-96fa-46f6-a304-814d602929f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133365b0-d4d2-40d1-8d90-3e823678ce0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133365b0-d4d2-40d1-8d90-3e823678ce0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1499286757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ccdcfc-3071-41d2-ac3e-39c42e64c136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe56e0b655e421bad52c1036c87716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:00:55Z,use_quota=True,user_id='8a3e1aa36b2849eaaf15e798943c774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae56fdc9-d297-4892-b833-c3d59f6d01e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae56fdc9-d297-4892-b833-c3d59f6d01e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd70b0a-9821-4014-a30a-fdb6e15d439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd70b0a-9821-4014-a30a-fdb6e15d439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ccdcfc-3071-41d2-ac3e-39c42e64c136', 'volume_name': 'volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b75f49-5bb2-4917-8cb6-b287c0eef7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b75f49-5bb2-4917-8cb6-b287c0eef7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af9ff86-d68d-4798-985f-d2a90d56bba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:55 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Volume c3ccdcfc-3071-41d2-ac3e-39c42e64c136: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136', 'volume_size': 1} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1499286757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ccdcfc-3071-41d2-ac3e-39c42e64c136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe56e0b655e421bad52c1036c87716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:00:55Z,use_quota=True,user_id='8a3e1aa36b2849eaaf15e798943c774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Creating volume c3ccdcfc-3071-41d2-ac3e-39c42e64c136 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:00:55 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:55 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136 1073741824 Apr 29 09:00:55 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:55 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8" returned: 0 in 0.934s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:55 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8 Apr 29 09:00:55 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:56 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136 1073741824" returned: 0 in 0.983s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:56 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136 Apr 29 09:00:56 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:56 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0.6d91320e-d4dc-4b15-85c6-6186eb83dfa8" returned: 0 in 0.881s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:56 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-6d91320e-d4dc-4b15-85c6-6186eb83dfa8" released by "_delete_snapshot" :: held 3.754s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:56 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-2329c631-35f0-445b-9663-356e2c9c8bb0" released by "delete_snapshot" :: held 3.781s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:56 devstack cinder-volume[83712]: WARNING cinder.quota [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-990212261 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-990212261, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:00:56 devstack cinder-volume[83712]: WARNING cinder.quota [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-990212261 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-990212261, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:00:56 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['6f919e25-6fe1-4112-8fc2-350bca8b00d7', 'f6e3741d-6774-44b2-9315-d07ae9240271', '0b581cdd-d038-4003-9559-9840a2130ea5', 'fe5b8088-f58f-4ee8-9e28-76056fe01145'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:56 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-56cd494a-511f-48ad-ba18-febdaa410090 tempest-GroupSnapshotsTest-1688921557 None] group_snapshot e6ef16cb-5b3e-4134-b3a7-5d95906f3f2b: deleted successfully Apr 29 09:00:57 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136" returned: 0 in 0.742s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af9ff86-d68d-4798-985f-d2a90d56bba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e878a68e-fa34-44dc-a1d7-4784903498c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:00:57 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Volume volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136 (c3ccdcfc-3071-41d2-ac3e-39c42e64c136): created successfully Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e878a68e-fa34-44dc-a1d7-4784903498c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Flow 'volume_create_manager' (30ce1879-96fa-46f6-a304-814d602929f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:00:57 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c06ed38b-b17b-40b8-9069-39750438c91b tempest-VolumesActionsTest-259837857 None] Created volume successfully. Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "cinder-quobyte-2329c631-35f0-445b-9663-356e2c9c8bb0" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-2329c631-35f0-445b-9663-356e2c9c8bb0" acquired by "delete_volume" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[8151e007-25ab-4177-85fc-3ee42e9c4a98]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Acquiring lock "cinder-c3ccdcfc-3071-41d2-ac3e-39c42e64c136-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-c3ccdcfc-3071-41d2-ac3e-39c42e64c136-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:57 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 Apr 29 09:00:57 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Acquiring lock "cinder-quobyte-c3ccdcfc-3071-41d2-ac3e-39c42e64c136" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-quobyte-c3ccdcfc-3071-41d2-ac3e-39c42e64c136" acquired by "delete_volume" :: waited 0.014s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8a35c5-4b84-4d9a-881b-ed225576153e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:00:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:57 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136 Apr 29 09:00:57 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:58 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0" returned: 0 in 0.958s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:58 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0 Apr 29 09:00:58 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:58 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136" returned: 0 in 1.014s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:58 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136 Apr 29 09:00:58 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:59 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2329c631-35f0-445b-9663-356e2c9c8bb0" returned: 0 in 0.719s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Lock "cinder-quobyte-2329c631-35f0-445b-9663-356e2c9c8bb0" released by "delete_volume" :: held 1.805s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['1938e32f-2e27-4ded-af49-8b20acf01b72'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:59 devstack cinder-volume[83712]: WARNING cinder.quota [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-990212261 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-990212261, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Created reservations ['9d6fa333-e772-40f8-b9b4-6a06ac56337e', '31c18f19-d649-4eaf-b6aa-7b9a80704d1f', 'c1c1d9d2-0248-4786-8b1f-cb2091b33bf3', '1120484c-36e2-4abc-9b17-387b651fa15c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:59 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3ccdcfc-3071-41d2-ac3e-39c42e64c136" returned: 0 in 0.732s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:59 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:00:59 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-quobyte-c3ccdcfc-3071-41d2-ac3e-39c42e64c136" released by "delete_volume" :: held 1.820s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:59 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:00:59 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Created reservations ['d943fefa-b30f-4f15-9783-d6cd081beb66', '606cf641-c86f-4f23-8e07-4fc869ef3b31', '53defcba-535c-4661-ba6c-5eefd6758dbb', 'a7db666f-fae7-4c4d-b8dc-c31de8f3d515'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:00:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:59 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:00:59 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:00 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.963s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:01:01 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.311s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Flow 'volume_create_manager' (78e24f84-155b-41c1-bc77-6eebc0a9db16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2577cab3-3812-4fb4-91fc-1052c897bf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:01 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Deleted volume successfully. Apr 29 09:01:01 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.566s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2577cab3-3812-4fb4-91fc-1052c897bf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-576071580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dede1bb-595e-44ac-b964-917c6f918058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe56e0b655e421bad52c1036c87716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:01Z,use_quota=True,user_id='8a3e1aa36b2849eaaf15e798943c774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b958cfb-a49a-4f02-bd53-6bcec1db88f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b958cfb-a49a-4f02-bd53-6bcec1db88f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712b7aa0-44e2-4297-8d07-3dd8ec4881eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712b7aa0-44e2-4297-8d07-3dd8ec4881eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dede1bb-595e-44ac-b964-917c6f918058', 'volume_name': 'volume-3dede1bb-595e-44ac-b964-917c6f918058', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76767a0-d2ec-43e9-8bf9-494ddcad4d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76767a0-d2ec-43e9-8bf9-494ddcad4d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a557031-45a8-42a6-9700-373578d44032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:01 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Volume 3dede1bb-595e-44ac-b964-917c6f918058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dede1bb-595e-44ac-b964-917c6f918058', 'volume_size': 1} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-576071580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dede1bb-595e-44ac-b964-917c6f918058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe56e0b655e421bad52c1036c87716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:01Z,use_quota=True,user_id='8a3e1aa36b2849eaaf15e798943c774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Creating volume 3dede1bb-595e-44ac-b964-917c6f918058 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:01:01 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3dede1bb-595e-44ac-b964-917c6f918058 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:01 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-2b0d1a07-a216-4eb7-9d24-64eb44c4402e tempest-GroupSnapshotsTest-1688921557 None] Delete group completed successfully. Apr 29 09:01:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-534bfb6d-feb7-4130-95ea-5e2fabc84068 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-c3ccdcfc-3071-41d2-ac3e-39c42e64c136-delete_volume" released by "delete_volume" :: held 3.617s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:01 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3dede1bb-595e-44ac-b964-917c6f918058 1073741824 Apr 29 09:01:01 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:02 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3dede1bb-595e-44ac-b964-917c6f918058 1073741824" returned: 0 in 1.290s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3dede1bb-595e-44ac-b964-917c6f918058 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:02 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3dede1bb-595e-44ac-b964-917c6f918058 Apr 29 09:01:02 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:03 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3dede1bb-595e-44ac-b964-917c6f918058" returned: 0 in 0.821s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:01:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a557031-45a8-42a6-9700-373578d44032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dede1bb-595e-44ac-b964-917c6f918058', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1e3726-a400-4103-9079-7b9857392c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:03 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Volume volume-3dede1bb-595e-44ac-b964-917c6f918058 (3dede1bb-595e-44ac-b964-917c6f918058): created successfully Apr 29 09:01:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1e3726-a400-4103-9079-7b9857392c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Flow 'volume_create_manager' (78e24f84-155b-41c1-bc77-6eebc0a9db16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:03 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-9ffa1f93-b26b-4554-bff6-76e56b630882 tempest-VolumesActionsTest-259837857 None] Created volume successfully. Apr 29 09:01:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Acquiring lock "cinder-3dede1bb-595e-44ac-b964-917c6f918058-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Lock "cinder-3dede1bb-595e-44ac-b964-917c6f918058-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Acquiring lock "cinder-quobyte-3dede1bb-595e-44ac-b964-917c6f918058" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Lock "cinder-quobyte-3dede1bb-595e-44ac-b964-917c6f918058" acquired by "delete_volume" :: waited 0.014s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:04 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[0165b5b8-3f1f-4bea-aa19-7c6f765c6f35]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3dede1bb-595e-44ac-b964-917c6f918058 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:04 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3dede1bb-595e-44ac-b964-917c6f918058 Apr 29 09:01:04 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:05 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3dede1bb-595e-44ac-b964-917c6f918058" returned: 0 in 0.793s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3dede1bb-595e-44ac-b964-917c6f918058 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:05 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3dede1bb-595e-44ac-b964-917c6f918058 Apr 29 09:01:05 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:06 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3dede1bb-595e-44ac-b964-917c6f918058" returned: 0 in 0.778s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Lock "cinder-quobyte-3dede1bb-595e-44ac-b964-917c6f918058" released by "delete_volume" :: held 1.684s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:06 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Created reservations ['c4225edb-1c74-4c10-863e-0d999c20bc38', '65f933c9-a79a-4841-8f1d-427a59f62842', 'eb3d2e13-4c47-427b-b3e3-97abdd290f77', 'fcc33ee1-ff03-4c59-ac1d-2582e5c2fe7b'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:01:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:06 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:01:06 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:07 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.835s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:01:07 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Deleted volume successfully. Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f11fd7c5-a750-415f-8036-82f9f4bfb40f tempest-VolumesActionsTest-1278016634 None] Lock "cinder-3dede1bb-595e-44ac-b964-917c6f918058-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Flow 'volume_create_manager' (eb63d516-8da4-421e-b302-6d97dccc9879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56796742-f727-44cb-8287-08be40c2ccb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56796742-f727-44cb-8287-08be40c2ccb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1747118570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2df585-e108-4cef-b488-bbbb2e049826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe56e0b655e421bad52c1036c87716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:08Z,use_quota=True,user_id='8a3e1aa36b2849eaaf15e798943c774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fb83f9-c084-49a0-a542-963327781981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fb83f9-c084-49a0-a542-963327781981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ee14b3-b99a-438a-a063-24d8cb9d2a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ee14b3-b99a-438a-a063-24d8cb9d2a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2df585-e108-4cef-b488-bbbb2e049826', 'volume_name': 'volume-3e2df585-e108-4cef-b488-bbbb2e049826', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38b1753-5300-4a2f-b591-3b799637c6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38b1753-5300-4a2f-b591-3b799637c6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749c2f31-0a93-4058-88ed-22744d366ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:07 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Volume 3e2df585-e108-4cef-b488-bbbb2e049826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2df585-e108-4cef-b488-bbbb2e049826', 'volume_size': 1} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1747118570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2df585-e108-4cef-b488-bbbb2e049826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe56e0b655e421bad52c1036c87716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:08Z,use_quota=True,user_id='8a3e1aa36b2849eaaf15e798943c774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Creating volume 3e2df585-e108-4cef-b488-bbbb2e049826 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:01:07 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:01:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3e2df585-e108-4cef-b488-bbbb2e049826 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:07 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3e2df585-e108-4cef-b488-bbbb2e049826 1073741824 Apr 29 09:01:07 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:09 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3e2df585-e108-4cef-b488-bbbb2e049826 1073741824" returned: 0 in 1.133s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3e2df585-e108-4cef-b488-bbbb2e049826 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:09 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3e2df585-e108-4cef-b488-bbbb2e049826 Apr 29 09:01:09 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:09 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3e2df585-e108-4cef-b488-bbbb2e049826" returned: 0 in 0.910s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:01:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749c2f31-0a93-4058-88ed-22744d366ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2df585-e108-4cef-b488-bbbb2e049826', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2c7b81-f480-4454-bbe3-9e530b9e57e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:10 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Volume volume-3e2df585-e108-4cef-b488-bbbb2e049826 (3e2df585-e108-4cef-b488-bbbb2e049826): created successfully Apr 29 09:01:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2c7b81-f480-4454-bbe3-9e530b9e57e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Flow 'volume_create_manager' (eb63d516-8da4-421e-b302-6d97dccc9879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:10 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-858f5371-ac6b-4519-85b4-3e9eea4330bf tempest-VolumesActionsTest-259837857 None] Created volume successfully. Apr 29 09:01:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Acquiring lock "cinder-3e2df585-e108-4cef-b488-bbbb2e049826-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-3e2df585-e108-4cef-b488-bbbb2e049826-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Acquiring lock "cinder-quobyte-3e2df585-e108-4cef-b488-bbbb2e049826" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-quobyte-3e2df585-e108-4cef-b488-bbbb2e049826" acquired by "delete_volume" :: waited 0.037s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:11 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[315fbf12-1dad-4dd9-bddd-b4e38fedddb4]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3e2df585-e108-4cef-b488-bbbb2e049826 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:11 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3e2df585-e108-4cef-b488-bbbb2e049826 Apr 29 09:01:11 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:12 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3e2df585-e108-4cef-b488-bbbb2e049826" returned: 0 in 0.817s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3e2df585-e108-4cef-b488-bbbb2e049826 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:12 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3e2df585-e108-4cef-b488-bbbb2e049826 Apr 29 09:01:12 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:12 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3e2df585-e108-4cef-b488-bbbb2e049826" returned: 0 in 0.772s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-quobyte-3e2df585-e108-4cef-b488-bbbb2e049826" released by "delete_volume" :: held 1.651s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:13 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Created reservations ['ab8fdfed-f9f5-4a80-90a3-a04b6ef1ed67', 'e3061314-6eff-47a1-af34-091a6b3382e8', 'e9f03437-05a8-4d4e-b475-6028524f923a', '05647689-4b8d-4b05-9f16-e8d9b9568faa'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:01:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:13 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:01:13 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.854s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:01:14 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:14 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Deleted volume successfully. Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ac902731-04aa-4c5f-ba63-6e1e0d629d55 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-3e2df585-e108-4cef-b488-bbbb2e049826-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Flow 'volume_create_manager' (222fbad2-d6b4-41ca-8dcd-9728dcaad411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b416ed-dcba-4618-83f7-38030e27385a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b416ed-dcba-4618-83f7-38030e27385a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-886449257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b539d0a0-4dac-4c90-8ae6-9a6320833156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe56e0b655e421bad52c1036c87716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:14Z,use_quota=True,user_id='8a3e1aa36b2849eaaf15e798943c774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baaaaa51-0740-4960-9d1c-626ca66ed6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baaaaa51-0740-4960-9d1c-626ca66ed6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1cac0e-d606-4881-9918-972846e58600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1cac0e-d606-4881-9918-972846e58600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b539d0a0-4dac-4c90-8ae6-9a6320833156', 'volume_name': 'volume-b539d0a0-4dac-4c90-8ae6-9a6320833156', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bf341b-c02e-4b6a-9568-ae0cc2207475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bf341b-c02e-4b6a-9568-ae0cc2207475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbfe411-6f08-44b3-83ca-4f6c5f2a0a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:14 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Volume b539d0a0-4dac-4c90-8ae6-9a6320833156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b539d0a0-4dac-4c90-8ae6-9a6320833156', 'volume_size': 1} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-886449257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b539d0a0-4dac-4c90-8ae6-9a6320833156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe56e0b655e421bad52c1036c87716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:14Z,use_quota=True,user_id='8a3e1aa36b2849eaaf15e798943c774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Creating volume b539d0a0-4dac-4c90-8ae6-9a6320833156 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:01:14 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:01:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b539d0a0-4dac-4c90-8ae6-9a6320833156 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:14 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b539d0a0-4dac-4c90-8ae6-9a6320833156 1073741824 Apr 29 09:01:14 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:15 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b539d0a0-4dac-4c90-8ae6-9a6320833156 1073741824" returned: 0 in 0.950s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b539d0a0-4dac-4c90-8ae6-9a6320833156 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:15 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b539d0a0-4dac-4c90-8ae6-9a6320833156 Apr 29 09:01:15 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:16 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b539d0a0-4dac-4c90-8ae6-9a6320833156" returned: 0 in 0.679s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbfe411-6f08-44b3-83ca-4f6c5f2a0a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b539d0a0-4dac-4c90-8ae6-9a6320833156', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74782db3-438f-450e-a8c3-142d0c8f192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:16 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Volume volume-b539d0a0-4dac-4c90-8ae6-9a6320833156 (b539d0a0-4dac-4c90-8ae6-9a6320833156): created successfully Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74782db3-438f-450e-a8c3-142d0c8f192a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Flow 'volume_create_manager' (222fbad2-d6b4-41ca-8dcd-9728dcaad411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:16 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8cf8f6b0-a4fb-4969-afcc-53157b39c9fe tempest-VolumesActionsTest-259837857 None] Created volume successfully. Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Acquiring lock "cinder-b539d0a0-4dac-4c90-8ae6-9a6320833156-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-b539d0a0-4dac-4c90-8ae6-9a6320833156-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Acquiring lock "cinder-quobyte-b539d0a0-4dac-4c90-8ae6-9a6320833156" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-quobyte-b539d0a0-4dac-4c90-8ae6-9a6320833156" acquired by "delete_volume" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f46b254-b887-4fff-a17a-047c06517d89]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b539d0a0-4dac-4c90-8ae6-9a6320833156 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:16 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b539d0a0-4dac-4c90-8ae6-9a6320833156 Apr 29 09:01:16 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:17 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b539d0a0-4dac-4c90-8ae6-9a6320833156" returned: 0 in 0.777s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b539d0a0-4dac-4c90-8ae6-9a6320833156 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:17 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b539d0a0-4dac-4c90-8ae6-9a6320833156 Apr 29 09:01:17 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:18 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b539d0a0-4dac-4c90-8ae6-9a6320833156" returned: 0 in 0.812s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-quobyte-b539d0a0-4dac-4c90-8ae6-9a6320833156" released by "delete_volume" :: held 1.650s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:18 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Created reservations ['b939cb58-7edc-4bd8-a1d8-ed5f4b624b69', 'a62ad0e6-19c3-4a38-8309-0167bbe2e867', 'aea3c469-2504-4978-97db-74957036d1e2', 'bb156194-8deb-496f-a4ab-1b5a8e18619e'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:01:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:18 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:01:18 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:01:19 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Flow 'volume_create_manager' (5772fd11-7cb9-4bbd-af8e-688442f7afa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5d0cd9-3806-4571-909e-c87a01e35337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.226s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5d0cd9-3806-4571-909e-c87a01e35337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1145153807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb9bb6f-3a12-491d-a9a2-8632721d92f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe56e0b655e421bad52c1036c87716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:20Z,use_quota=True,user_id='8a3e1aa36b2849eaaf15e798943c774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db306f0d-6860-428a-92e4-3899adacac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db306f0d-6860-428a-92e4-3899adacac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f376b919-13de-4368-8ce6-2f73d9b51f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f376b919-13de-4368-8ce6-2f73d9b51f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb9bb6f-3a12-491d-a9a2-8632721d92f5', 'volume_name': 'volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402c5f6d-5fa6-4090-80bc-e44c0cccc5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402c5f6d-5fa6-4090-80bc-e44c0cccc5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debaba8f-2255-43de-aeaa-6fc88959359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:19 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Volume 1bb9bb6f-3a12-491d-a9a2-8632721d92f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5', 'volume_size': 1} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1145153807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb9bb6f-3a12-491d-a9a2-8632721d92f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe56e0b655e421bad52c1036c87716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:20Z,use_quota=True,user_id='8a3e1aa36b2849eaaf15e798943c774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Creating volume 1bb9bb6f-3a12-491d-a9a2-8632721d92f5 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:01:19 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:19 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Deleted volume successfully. Apr 29 09:01:19 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5 1073741824 Apr 29 09:01:19 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d00f1535-d5e9-4827-8c0c-f4bd19f7ac12 tempest-VolumesActionsTest-1278016634 None] Lock "cinder-b539d0a0-4dac-4c90-8ae6-9a6320833156-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:20 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5 1073741824" returned: 0 in 1.068s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Flow 'volume_create_manager' (3f9d6f08-6120-456d-a840-b40f7d4138cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f731dc-c8ed-4afe-bb96-2b75aa2c9021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f731dc-c8ed-4afe-bb96-2b75aa2c9021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-633305446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7feb2f0f-0900-4bec-a775-9db8d85ac042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc302ec8fb1a42e788805df1fb230c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:21Z,use_quota=True,user_id='2f09378228d249deb63587a17dedf025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:20 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5 Apr 29 09:01:20 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce331215-5475-491f-b9c9-3044238a1422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce331215-5475-491f-b9c9-3044238a1422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7907c7e5-4630-4969-ae85-d2dd931e167c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7907c7e5-4630-4969-ae85-d2dd931e167c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7feb2f0f-0900-4bec-a775-9db8d85ac042', 'volume_name': 'volume-7feb2f0f-0900-4bec-a775-9db8d85ac042', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62078516-0181-40b2-9c53-1110ad776931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62078516-0181-40b2-9c53-1110ad776931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4fed09-81c3-4286-9b18-abdbea5f6686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:21 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Volume 7feb2f0f-0900-4bec-a775-9db8d85ac042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7feb2f0f-0900-4bec-a775-9db8d85ac042', 'volume_size': 1} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:21 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5" returned: 0 in 0.603s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.537s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-633305446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7feb2f0f-0900-4bec-a775-9db8d85ac042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc302ec8fb1a42e788805df1fb230c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:21Z,use_quota=True,user_id='2f09378228d249deb63587a17dedf025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Creating volume 7feb2f0f-0900-4bec-a775-9db8d85ac042 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:01:21 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:21 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 1073741824 Apr 29 09:01:21 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debaba8f-2255-43de-aeaa-6fc88959359f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c794bf21-3748-4521-9e39-ac48814c6a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:21 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Volume volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5 (1bb9bb6f-3a12-491d-a9a2-8632721d92f5): created successfully Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c794bf21-3748-4521-9e39-ac48814c6a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Flow 'volume_create_manager' (5772fd11-7cb9-4bbd-af8e-688442f7afa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:21 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-98991c36-8a68-4b9d-ada2-6fa376bbd9be tempest-VolumesActionsTest-259837857 None] Created volume successfully. Apr 29 09:01:22 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 1073741824" returned: 0 in 0.951s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:22 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 Apr 29 09:01:22 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:23 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042" returned: 0 in 0.755s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4fed09-81c3-4286-9b18-abdbea5f6686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7feb2f0f-0900-4bec-a775-9db8d85ac042', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b972bd2f-7c06-428d-81c0-b9f3872cdd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:23 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Volume volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 (7feb2f0f-0900-4bec-a775-9db8d85ac042): created successfully Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b972bd2f-7c06-428d-81c0-b9f3872cdd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Flow 'volume_create_manager' (3f9d6f08-6120-456d-a840-b40f7d4138cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:23 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-2b5d113d-6243-4782-98b8-1de464996e97 tempest-SnapshotDependencyTests-1088465248 None] Created volume successfully. Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Flow 'volume_create_manager' (5172dc45-179e-4b3d-b4d2-5306b554fdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04142a6-ddc1-46ec-8024-5566215e9271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04142a6-ddc1-46ec-8024-5566215e9271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1881856221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b500edff16284d60b48fd28944970dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:23Z,use_quota=True,user_id='e533fff104de4ab7a8a67750c828ca23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9409aa-3d4b-4738-bcbd-0c14789c96da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9409aa-3d4b-4738-bcbd-0c14789c96da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11496f36-13c5-43f1-a2b6-f0d2b1085a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11496f36-13c5-43f1-a2b6-f0d2b1085a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb', 'volume_name': 'volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7228a0b-00c2-4d3a-8612-96a15d807d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7228a0b-00c2-4d3a-8612-96a15d807d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2a5ac8-59a4-4d63-8642-12317cb16f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:23 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Volume d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb', 'volume_size': 1} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1881856221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b500edff16284d60b48fd28944970dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:23Z,use_quota=True,user_id='e533fff104de4ab7a8a67750c828ca23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Creating volume d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:01:23 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Acquiring lock "cinder-1bb9bb6f-3a12-491d-a9a2-8632721d92f5-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:23 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb 1073741824 Apr 29 09:01:23 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Lock "cinder-1bb9bb6f-3a12-491d-a9a2-8632721d92f5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Acquiring lock "cinder-quobyte-1bb9bb6f-3a12-491d-a9a2-8632721d92f5" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Lock "cinder-quobyte-1bb9bb6f-3a12-491d-a9a2-8632721d92f5" acquired by "delete_volume" :: waited 0.018s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d3be8e-912e-4377-8454-19dc079384dc]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:23 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5 Apr 29 09:01:23 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:24 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5" returned: 0 in 0.838s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:24 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5 Apr 29 09:01:24 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:24 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb 1073741824" returned: 0 in 1.002s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:24 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb Apr 29 09:01:24 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:25 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1bb9bb6f-3a12-491d-a9a2-8632721d92f5" returned: 0 in 0.671s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Lock "cinder-quobyte-1bb9bb6f-3a12-491d-a9a2-8632721d92f5" released by "delete_volume" :: held 1.568s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Created reservations ['30ce6278-472c-47f8-a508-c818fbb812e7', 'b42a02d3-cf78-4470-a8f9-052985329870', 'fdb41649-57c4-4f28-8162-fb8e56bbfc2e', 'e6c6df1b-baf9-4bdf-b9e1-be990550450b'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:01:25 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" returned: 0 in 0.683s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.870s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2a5ac8-59a4-4d63-8642-12317cb16f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f57a57f-0fcb-4952-a003-fb9058117bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] Creating offline snapshot b53e9198-8a04-4716-8318-c5fd890aac0e of volume 7feb2f0f-0900-4bec-a775-9db8d85ac042 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:01:25 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Volume volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb (d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb): created successfully Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f57a57f-0fcb-4952-a003-fb9058117bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Flow 'volume_create_manager' (5172dc45-179e-4b3d-b4d2-5306b554fdcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c7ecc7-633a-49da-becf-afdc6dc46dee]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:25 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-adb9350a-ce14-4904-a9db-a7a297b94c40 tempest-SnapshotsActionsTest-1944189273 None] Created volume successfully. Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:25 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:01:25 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:25 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 Apr 29 09:01:25 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:26 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.806s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:26 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:01:26 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Deleted volume successfully. Apr 29 09:01:26 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-754dea4b-1d0e-454a-81da-0b4695372c78 tempest-VolumesActionsTest-259837857 None] Lock "cinder-1bb9bb6f-3a12-491d-a9a2-8632721d92f5-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:26 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042" returned: 0 in 1.030s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:26 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e 1G Apr 29 09:01:26 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:27 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e 1G" returned: 0 in 0.940s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:27 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e Apr 29 09:01:27 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:28 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e" returned: 0 in 0.767s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:28 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e is being set with open permissions: ugo+rw Apr 29 09:01:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:28 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e Apr 29 09:01:28 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:28 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e" returned: 0 in 0.691s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:28 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.info Apr 29 09:01:28 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:29 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.info" returned: 0 in 0.673s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:29 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.info is being set with open permissions: ugo+rw Apr 29 09:01:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:29 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.info Apr 29 09:01:29 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:30 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.info" returned: 0 in 0.727s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.415s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] Creating offline snapshot 24c592d7-fd32-485a-80d4-f9f65599b750 of volume d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:01:30 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a1381e4a-b93f-4356-96af-b95e78400a89 tempest-SnapshotDependencyTests-1088465248 None] Create snapshot completed successfully Apr 29 09:01:30 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a6e796-bba3-4c8f-bd32-a68238e95c78]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:30 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb Apr 29 09:01:30 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:31 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" returned: 0 in 0.894s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:31 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 1G Apr 29 09:01:31 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Flow 'volume_create_manager' (3e07a054-9b98-4c3d-8b28-b871971164cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c183f92-6884-4c53-8f8e-ab43a4bcd89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c183f92-6884-4c53-8f8e-ab43a4bcd89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f760e1c7-1ae9-407d-875d-ca2eeca91259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc302ec8fb1a42e788805df1fb230c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b53e9198-8a04-4716-8318-c5fd890aac0e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:31Z,use_quota=True,user_id='2f09378228d249deb63587a17dedf025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec79ff67-c713-448d-bb74-33b2fc1ad579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec79ff67-c713-448d-bb74-33b2fc1ad579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b0a468-9c87-4999-89e9-449265c212b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b0a468-9c87-4999-89e9-449265c212b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f760e1c7-1ae9-407d-875d-ca2eeca91259', 'volume_name': 'volume-f760e1c7-1ae9-407d-875d-ca2eeca91259', 'volume_size': 1, 'snapshot_id': 'b53e9198-8a04-4716-8318-c5fd890aac0e'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e59a29-92be-479d-a452-8aca334e76db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e59a29-92be-479d-a452-8aca334e76db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c193506-96e4-47df-90b6-623ff0693158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:31 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Volume f760e1c7-1ae9-407d-875d-ca2eeca91259: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f760e1c7-1ae9-407d-875d-ca2eeca91259', 'volume_size': 1, 'snapshot_id': 'b53e9198-8a04-4716-8318-c5fd890aac0e'} Apr 29 09:01:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:32 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 1G" returned: 0 in 0.998s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:32 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:01:32 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:33 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.804s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:33 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 is being set with open permissions: ugo+rw Apr 29 09:01:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:33 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:01:33 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:33 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.760s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:33 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.info Apr 29 09:01:33 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:34 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.info" returned: 0 in 0.667s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:34 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.info is being set with open permissions: ugo+rw Apr 29 09:01:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:34 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.info Apr 29 09:01:34 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:35 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.info" returned: 0 in 0.711s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.961s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.635s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "cinder-quobyte-b53e9198-8a04-4716-8318-c5fd890aac0e-f760e1c7-1ae9-407d-875d-ca2eeca91259" by "_create_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-quobyte-b53e9198-8a04-4716-8318-c5fd890aac0e-f760e1c7-1ae9-407d-875d-ca2eeca91259" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Creating volume f760e1c7-1ae9-407d-875d-ca2eeca91259 from snapshot b53e9198-8a04-4716-8318-c5fd890aac0e {{(pid=83712) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "cinder-quobyte-f760e1c7-1ae9-407d-875d-ca2eeca91259" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:35 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-9a8d2925-951a-41a5-9b66-8a6f5e11541c tempest-SnapshotsActionsTest-1944189273 None] Create snapshot completed successfully Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-quobyte-f760e1c7-1ae9-407d-875d-ca2eeca91259" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] snapshot: b53e9198-8a04-4716-8318-c5fd890aac0e, volume: f760e1c7-1ae9-407d-875d-ca2eeca91259, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf59814-8c76-4a88-9ac4-95a0fc8b5aed]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:35 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e Apr 29 09:01:35 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:36 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e" returned: 0 in 0.808s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7feb2f0f-0900-4bec-a775-9db8d85ac042(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[3933bd1a-60d6-4d9b-9fd1-7f7351df7ce4]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:36 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 Apr 29 09:01:36 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=108,cinder:UPDATE=137,cinder:INSERT=26,cinder:DELETE=8 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:UPDATE=121,cinder:SELECT=104,cinder:INSERT=34,cinder:DELETE=10 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Flow 'volume_create_manager' (b9296680-b975-4e0e-a28a-242dd574a0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f4aa63-5573-4cc7-b14f-23735bd90e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f4aa63-5573-4cc7-b14f-23735bd90e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2037913713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b459494-06f8-41f7-825d-8c9bd133ad60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1538639263d640e9972dd08e7bc41470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:37Z,use_quota=True,user_id='149deef4625c488aa380fb161ddfe6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a398b75d-f0ef-4ae0-9d74-4cd0fcdfb280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a398b75d-f0ef-4ae0-9d74-4cd0fcdfb280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f1df2f-8b80-4907-bb1b-a07873115de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f1df2f-8b80-4907-bb1b-a07873115de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b459494-06f8-41f7-825d-8c9bd133ad60', 'volume_name': 'volume-8b459494-06f8-41f7-825d-8c9bd133ad60', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87678f50-4836-40b2-8fb7-0438cc70b5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87678f50-4836-40b2-8fb7-0438cc70b5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5dbc94-81b9-4523-a2fc-d4232a6b5b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:37 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Volume 8b459494-06f8-41f7-825d-8c9bd133ad60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b459494-06f8-41f7-825d-8c9bd133ad60', 'volume_size': 1} Apr 29 09:01:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:37 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042" returned: 0 in 0.918s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:37 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259 not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:01:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:37 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259 Apr 29 09:01:37 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:39 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:01:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Flow 'volume_create_manager' (6eb1c180-119a-4a6f-96d4-383155a41fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d422ae06-e36e-435a-b4fa-c3730acd6096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d422ae06-e36e-435a-b4fa-c3730acd6096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-544092668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124dbaf7-ffe6-4791-aee0-3474a91eabd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a81c6daf7fc48f091d6c9eac8a8ae96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:39Z,use_quota=True,user_id='eb68e9ca182842828d9f04219eff1a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee98e7d-40f1-4797-a902-b7248b7c689c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee98e7d-40f1-4797-a902-b7248b7c689c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d7c529-cccf-473c-913d-06da5ae1c91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d7c529-cccf-473c-913d-06da5ae1c91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '124dbaf7-ffe6-4791-aee0-3474a91eabd8', 'volume_name': 'volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b4a579-f89d-4db6-b029-a12a4548c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b4a579-f89d-4db6-b029-a12a4548c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97f3ef3-b246-4928-bb8e-cf703425cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:39 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Volume 124dbaf7-ffe6-4791-aee0-3474a91eabd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8', 'volume_size': 1} Apr 29 09:01:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:42 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259" returned: 0 in 4.906s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:42 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[82039ee3-a184-42fc-ab8d-89cf2761bee5]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:42 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 Apr 29 09:01:42 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:42 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042" returned: 0 in 0.845s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:42 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259 {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:01:42 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Converted 1024.00 MB image at 208.65 MB/s Apr 29 09:01:42 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259 is being set with open permissions: ugo+rw Apr 29 09:01:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:42 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259 Apr 29 09:01:42 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:43 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259" returned: 0 in 0.590s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-quobyte-f760e1c7-1ae9-407d-875d-ca2eeca91259" released by "_copy_volume_from_snapshot" :: held 8.198s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-quobyte-b53e9198-8a04-4716-8318-c5fd890aac0e-f760e1c7-1ae9-407d-875d-ca2eeca91259" released by "_create_volume_from_snapshot" :: held 8.249s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.301s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.560s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2037913713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b459494-06f8-41f7-825d-8c9bd133ad60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1538639263d640e9972dd08e7bc41470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:37Z,use_quota=True,user_id='149deef4625c488aa380fb161ddfe6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Creating volume 8b459494-06f8-41f7-825d-8c9bd133ad60 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:01:43 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:43 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 1073741824 Apr 29 09:01:43 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c193506-96e4-47df-90b6-623ff0693158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f760e1c7-1ae9-407d-875d-ca2eeca91259', 'volume_size': 1, 'snapshot_id': 'b53e9198-8a04-4716-8318-c5fd890aac0e'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c34b72-8cbd-469b-a312-27f238a789da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:43 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Volume volume-f760e1c7-1ae9-407d-875d-ca2eeca91259 (f760e1c7-1ae9-407d-875d-ca2eeca91259): created successfully Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c34b72-8cbd-469b-a312-27f238a789da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Flow 'volume_create_manager' (3e07a054-9b98-4c3d-8b28-b871971164cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:43 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8af9e915-b317-4850-86f3-7d3bea10f8fd tempest-SnapshotDependencyTests-1088465248 None] Created volume successfully. Apr 29 09:01:44 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 1073741824" returned: 0 in 0.823s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:44 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 Apr 29 09:01:44 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "cinder-b53e9198-8a04-4716-8318-c5fd890aac0e-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-b53e9198-8a04-4716-8318-c5fd890aac0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "cinder-quobyte-7feb2f0f-0900-4bec-a775-9db8d85ac042" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-quobyte-7feb2f0f-0900-4bec-a775-9db8d85ac042" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "cinder-quobyte-b53e9198-8a04-4716-8318-c5fd890aac0e" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-quobyte-b53e9198-8a04-4716-8318-c5fd890aac0e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Deleting offline snapshot b53e9198-8a04-4716-8318-c5fd890aac0e of volume 7feb2f0f-0900-4bec-a775-9db8d85ac042 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:01:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] snapshot_file for this snap is: volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:01:44 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[799938a2-8913-48bd-a3ca-60c309f4de14]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:44 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e Apr 29 09:01:44 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:45 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60" returned: 0 in 0.608s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.948s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] Creating offline snapshot f89d2581-0011-457d-9fff-6c13b8191f77 of volume d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5dbc94-81b9-4523-a2fc-d4232a6b5b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b459494-06f8-41f7-825d-8c9bd133ad60', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caddce93-67dc-4498-8cce-d8ddc91392f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[70db7387-303d-4e9f-99fe-921fd72481a6]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:45 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Volume volume-8b459494-06f8-41f7-825d-8c9bd133ad60 (8b459494-06f8-41f7-825d-8c9bd133ad60): created successfully Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caddce93-67dc-4498-8cce-d8ddc91392f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Flow 'volume_create_manager' (b9296680-b975-4e0e-a28a-242dd574a0dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:45 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-3fb292e8-462a-4e41-aec0-21d18f2f7d93 tempest-VolumesDeleteCascade-112774499 None] Created volume successfully. Apr 29 09:01:45 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:01:45 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:45 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e" returned: 0 in 0.731s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7feb2f0f-0900-4bec-a775-9db8d85ac042(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5476b3e-b768-4cba-9dce-41ca6e8af28b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:45 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 Apr 29 09:01:45 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:45 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.778s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:01:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:45 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 1G Apr 29 09:01:45 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:46 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042" returned: 0 in 0.791s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:46 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e Apr 29 09:01:46 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:46 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 1G" returned: 0 in 0.913s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:46 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 Apr 29 09:01:46 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:46 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e" returned: 0 in 0.740s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:47 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e Apr 29 09:01:47 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:47 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77" returned: 0 in 0.700s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:47 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 is being set with open permissions: ugo+rw Apr 29 09:01:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:47 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 Apr 29 09:01:47 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:47 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042.b53e9198-8a04-4716-8318-c5fd890aac0e" returned: 0 in 0.611s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-quobyte-b53e9198-8a04-4716-8318-c5fd890aac0e" released by "_delete_snapshot" :: held 2.986s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-quobyte-7feb2f0f-0900-4bec-a775-9db8d85ac042" released by "delete_snapshot" :: held 3.015s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:47 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Created reservations ['d53fbbec-3dcb-4f80-8778-a8f20684e010', '60f93264-7244-499c-9cf2-acf172d55264', '67ed499f-1c20-4bfa-9d72-fa7576a4057c', '6be0e9a4-cf77-4bea-ab80-e073c728219c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:01:47 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Delete snapshot completed successfully. Apr 29 09:01:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9bd9c59c-162b-4cf1-ba72-ebad324ad3eb tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-b53e9198-8a04-4716-8318-c5fd890aac0e-delete_snapshot" released by "delete_snapshot" :: held 3.167s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:48 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77" returned: 0 in 0.610s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.102s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.887s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-544092668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124dbaf7-ffe6-4791-aee0-3474a91eabd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a81c6daf7fc48f091d6c9eac8a8ae96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:01:39Z,use_quota=True,user_id='eb68e9ca182842828d9f04219eff1a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Creating volume 124dbaf7-ffe6-4791-aee0-3474a91eabd8 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:01:48 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:48 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 1073741824 Apr 29 09:01:48 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:48 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-5c1e52c9-3320-4ffe-9ed7-a239593611a2 tempest-SnapshotsActionsTest-1944189273 None] Create snapshot completed successfully Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Acquiring lock "cinder-f89d2581-0011-457d-9fff-6c13b8191f77-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "cinder-7feb2f0f-0900-4bec-a775-9db8d85ac042-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-f89d2581-0011-457d-9fff-6c13b8191f77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Acquiring lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-7feb2f0f-0900-4bec-a775-9db8d85ac042-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Acquiring lock "cinder-quobyte-f89d2581-0011-457d-9fff-6c13b8191f77" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-f89d2581-0011-457d-9fff-6c13b8191f77" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Deleting offline snapshot f89d2581-0011-457d-9fff-6c13b8191f77 of volume d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] snapshot_file for this snap is: volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "cinder-quobyte-7feb2f0f-0900-4bec-a775-9db8d85ac042" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fba326f-0823-4771-a682-1f50275355b2]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-quobyte-7feb2f0f-0900-4bec-a775-9db8d85ac042" acquired by "delete_volume" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cc82d4-f4c5-4076-b5a0-ed4a9f344aeb]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:49 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 Apr 29 09:01:49 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:49 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 1073741824" returned: 0 in 0.917s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:49 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 Apr 29 09:01:49 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:49 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 Apr 29 09:01:49 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:49 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77" returned: 0 in 0.771s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[c614e3e1-16e3-4c36-9e3d-1e74db1d3061]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:49 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8" returned: 0 in 0.657s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.779s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:49 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] Creating offline snapshot e93f992f-676c-4ce2-9987-c53ae4255ee1 of volume 8b459494-06f8-41f7-825d-8c9bd133ad60 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042" returned: 0 in 0.797s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97f3ef3-b246-4928-bb8e-cf703425cba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073069ff-8e8e-4466-b75b-b3ab20beb972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ddafa7-eed4-4a9b-ac8b-3298bc50f473]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:49 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042 Apr 29 09:01:49 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:49 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:01:49 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:49 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Volume volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 (124dbaf7-ffe6-4791-aee0-3474a91eabd8): created successfully Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073069ff-8e8e-4466-b75b-b3ab20beb972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:01:49 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Flow 'volume_create_manager' (6eb1c180-119a-4a6f-96d4-383155a41fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:01:49 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6772848e-3473-4ffc-afa3-c9befba7861f tempest-SnapshotMetadataTestJSON-1868293877 None] Created volume successfully. Apr 29 09:01:50 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 Apr 29 09:01:50 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:50 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-7feb2f0f-0900-4bec-a775-9db8d85ac042" returned: 0 in 0.684s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:50 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.775s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-quobyte-7feb2f0f-0900-4bec-a775-9db8d85ac042" released by "delete_volume" :: held 1.578s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:50 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 Apr 29 09:01:50 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Created reservations ['4e66eb44-d9dc-4f41-852c-423c3492b338', '0040dc7e-b2cb-49f1-b036-2d44008122cd', 'bd3825c8-e8d4-472b-9c9d-d3f5786cfacf', '4d82c78d-2953-4ddc-b76c-93da51689cc9'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:01:50 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60" returned: 0 in 0.789s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:50 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 1G Apr 29 09:01:50 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:50 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:01:50 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "cinder-f760e1c7-1ae9-407d-875d-ca2eeca91259-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-f760e1c7-1ae9-407d-875d-ca2eeca91259-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "cinder-quobyte-f760e1c7-1ae9-407d-875d-ca2eeca91259" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-quobyte-f760e1c7-1ae9-407d-875d-ca2eeca91259" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[730e0ac7-1695-410d-91bc-3e836abaf080]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:51 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259 Apr 29 09:01:51 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:51 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77" returned: 0 in 0.968s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:51 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77 Apr 29 09:01:51 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:51 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 1G" returned: 0 in 0.907s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b459494-06f8-41f7-825d-8c9bd133ad60 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:51 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.821s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:01:51 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Deleted volume successfully. Apr 29 09:01:51 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b459494-06f8-41f7-825d-8c9bd133ad60 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 Apr 29 09:01:51 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:51 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a59ded5b-ba72-4185-848c-b33996a983e5 tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-7feb2f0f-0900-4bec-a775-9db8d85ac042-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:52 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259" returned: 0 in 0.854s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:52 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259 Apr 29 09:01:52 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:52 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.f89d2581-0011-457d-9fff-6c13b8191f77" returned: 0 in 0.647s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-f89d2581-0011-457d-9fff-6c13b8191f77" released by "_delete_snapshot" :: held 3.293s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" released by "delete_snapshot" :: held 3.325s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:52 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b459494-06f8-41f7-825d-8c9bd133ad60 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1" returned: 0 in 0.682s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:52 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 is being set with open permissions: ugo+rw Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:52 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 Apr 29 09:01:52 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Created reservations ['984ec630-836a-45c4-97c4-e62e2be8405d', '0e9493a8-6301-4ab0-b914-eaca4bce7cd4', '6d0b678c-98aa-4977-934c-e6accda8b233', '689e252f-1248-4b2c-a1ba-0ad493b84993'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:01:52 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Delete snapshot completed successfully. Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1fe5ba5-ad48-4866-9037-59ca3fbb435b tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-f89d2581-0011-457d-9fff-6c13b8191f77-delete_snapshot" released by "delete_snapshot" :: held 3.519s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:52 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f760e1c7-1ae9-407d-875d-ca2eeca91259" returned: 0 in 0.631s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-quobyte-f760e1c7-1ae9-407d-875d-ca2eeca91259" released by "delete_volume" :: held 1.534s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Created reservations ['5dff0c50-3ec6-4442-8f6c-26c577437591', '64e81668-d9bf-48f2-8ac7-4871917ff496', '4ce0c28b-dcd9-4294-bbed-24d6670ab325', '18aa5338-2000-41b3-aad7-6fef41554adb'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:52 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:01:52 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:52 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1" returned: 0 in 0.684s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:52 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.info Apr 29 09:01:52 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:53 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.730s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:53 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:01:53 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Deleted volume successfully. Apr 29 09:01:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0581df92-db98-400a-8f2b-6acea7c54375 tempest-SnapshotDependencyTests-1088465248 None] Lock "cinder-f760e1c7-1ae9-407d-875d-ca2eeca91259-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:01:53 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.info" returned: 0 in 0.704s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:53 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.info is being set with open permissions: ugo+rw Apr 29 09:01:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:53 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.info Apr 29 09:01:53 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:54 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.info" returned: 0 in 0.628s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.516s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.327s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] Creating offline snapshot 15675639-ab84-44a9-8367-31deed20062e of volume 124dbaf7-ffe6-4791-aee0-3474a91eabd8 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:01:54 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-21555aa3-ebfc-4202-a41d-282bf842c9bf tempest-VolumesDeleteCascade-112774499 None] Create snapshot completed successfully Apr 29 09:01:54 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95805a2-78d4-4287-a185-cd4e437bed05]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:54 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 Apr 29 09:01:54 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:55 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8" returned: 0 in 0.782s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:55 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e 1G Apr 29 09:01:55 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:55 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e 1G" returned: 0 in 0.842s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:56 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e Apr 29 09:01:56 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:56 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e" returned: 0 in 0.739s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:56 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e is being set with open permissions: ugo+rw Apr 29 09:01:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:56 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e Apr 29 09:01:56 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:57 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e" returned: 0 in 0.627s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:57 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.info Apr 29 09:01:57 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:58 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.info" returned: 0 in 0.641s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:58 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.info is being set with open permissions: ugo+rw Apr 29 09:01:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:58 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.info Apr 29 09:01:58 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:58 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.info" returned: 0 in 0.652s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.391s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.225s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] Creating offline snapshot 69214c46-5453-4ab4-8393-7cf2c6120ba3 of volume d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:01:58 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ac232649-2245-4371-906f-2a0bcd08794c tempest-SnapshotMetadataTestJSON-1868293877 None] Create snapshot completed successfully Apr 29 09:01:58 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[843d18df-ee2d-4558-8c5c-ec666e901633]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:01:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:58 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:01:58 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:01:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:01:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:01:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:01:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:01:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:01:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:59 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:01:59 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:59 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.838s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:01:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:59 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 1G Apr 29 09:01:59 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Acquiring lock "cinder-15675639-ab84-44a9-8367-31deed20062e-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "cinder-15675639-ab84-44a9-8367-31deed20062e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Acquiring lock "cinder-quobyte-124dbaf7-ffe6-4791-aee0-3474a91eabd8" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "cinder-quobyte-124dbaf7-ffe6-4791-aee0-3474a91eabd8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Acquiring lock "cinder-quobyte-15675639-ab84-44a9-8367-31deed20062e" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "cinder-quobyte-15675639-ab84-44a9-8367-31deed20062e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Deleting offline snapshot 15675639-ab84-44a9-8367-31deed20062e of volume 124dbaf7-ffe6-4791-aee0-3474a91eabd8 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] snapshot_file for this snap is: volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1f1333-b401-489d-9b9b-e26de0fd03e6]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:00 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e Apr 29 09:02:00 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:00 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.888s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:00 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 1G" returned: 0 in 1.021s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:00 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 Apr 29 09:02:00 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:01 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e" returned: 0 in 0.909s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:01 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b547252-6a5c-42a0-a68b-a6873284134e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:01 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 Apr 29 09:02:01 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:01 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3" returned: 0 in 0.719s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:01 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 is being set with open permissions: ugo+rw Apr 29 09:02:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:01 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 Apr 29 09:02:01 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:02 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3" returned: 0 in 0.649s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.373s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.492s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] Creating offline snapshot eb2eac39-105c-468a-b134-57f208ab584d of volume 8b459494-06f8-41f7-825d-8c9bd133ad60 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:02:02 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8" returned: 0 in 0.927s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:02 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56dc185-a667-4c80-bd87-10f9a4935b96]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:02 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e Apr 29 09:02:02 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e638c096-6b01-46f4-958b-e96b2ec160ab tempest-SnapshotsActionsTest-1944189273 None] Create snapshot completed successfully Apr 29 09:02:02 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:02 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 Apr 29 09:02:02 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:03 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1" returned: 0 in 0.829s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b459494-06f8-41f7-825d-8c9bd133ad60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:03 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d 1G Apr 29 09:02:03 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Acquiring lock "cinder-69214c46-5453-4ab4-8393-7cf2c6120ba3-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:03 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e" returned: 0 in 0.902s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-69214c46-5453-4ab4-8393-7cf2c6120ba3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Acquiring lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:03 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e Apr 29 09:02:03 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Acquiring lock "cinder-quobyte-69214c46-5453-4ab4-8393-7cf2c6120ba3" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-69214c46-5453-4ab4-8393-7cf2c6120ba3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Deleting offline snapshot 69214c46-5453-4ab4-8393-7cf2c6120ba3 of volume d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] snapshot_file for this snap is: volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a3cd33-706c-4b48-8736-d8cac18a5fa8]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:03 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 Apr 29 09:02:03 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:03 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8.15675639-ab84-44a9-8367-31deed20062e" returned: 0 in 0.669s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "cinder-quobyte-15675639-ab84-44a9-8367-31deed20062e" released by "_delete_snapshot" :: held 3.546s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "cinder-quobyte-124dbaf7-ffe6-4791-aee0-3474a91eabd8" released by "delete_snapshot" :: held 3.572s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Created reservations ['5489bc8f-2bc6-4032-804b-3f0a66534244', '1eed8873-9280-44de-bcb1-fa67c453bd9e', '752ded96-daec-46cc-aae1-946de16eb647', '92899f1b-91d5-417c-b235-5f01d20840f8'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:03 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Delete snapshot completed successfully. Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b1053875-5ec4-47e5-b587-02af04b1dfc4 tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "cinder-15675639-ab84-44a9-8367-31deed20062e-delete_snapshot" released by "delete_snapshot" :: held 3.733s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:03 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d 1G" returned: 0 in 0.956s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:03 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3" returned: 0 in 0.809s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:03 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d Apr 29 09:02:03 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aedde29-ad99-4f34-8408-c8d6ec8be28f]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:04 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:02:04 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Acquiring lock "cinder-124dbaf7-ffe6-4791-aee0-3474a91eabd8-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "cinder-124dbaf7-ffe6-4791-aee0-3474a91eabd8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Acquiring lock "cinder-quobyte-124dbaf7-ffe6-4791-aee0-3474a91eabd8" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "cinder-quobyte-124dbaf7-ffe6-4791-aee0-3474a91eabd8" acquired by "delete_volume" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[341e407f-88f0-47d6-8547-6267cb40bd7e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:04 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d" returned: 0 in 0.734s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:04 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d is being set with open permissions: ugo+rw Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:04 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d Apr 29 09:02:04 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:04 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 Apr 29 09:02:04 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:04 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.772s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:04 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 Apr 29 09:02:04 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:05 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d" returned: 0 in 0.681s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.330s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:05 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8" returned: 0 in 0.782s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:05 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-5728a28c-0ba7-4632-8f46-735bdbde04e0 tempest-VolumesDeleteCascade-112774499 None] Create snapshot completed successfully Apr 29 09:02:05 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8 Apr 29 09:02:05 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:05 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3" returned: 0 in 0.717s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:05 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3 Apr 29 09:02:05 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:06 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-124dbaf7-ffe6-4791-aee0-3474a91eabd8" returned: 0 in 0.606s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "cinder-quobyte-124dbaf7-ffe6-4791-aee0-3474a91eabd8" released by "delete_volume" :: held 1.459s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-8b459494-06f8-41f7-825d-8c9bd133ad60-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Created reservations ['bc953009-004e-4eb7-a8ac-a9cf59560f05', 'd5ed508e-07ef-4725-8d6c-391ea52cfb8b', 'b7aa8d76-6940-4277-8ead-a56c0b6d2a8a', '44e05ace-5c6e-4b05-ba13-3cba3de4b9e2'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-8b459494-06f8-41f7-825d-8c9bd133ad60-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:06 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.69214c46-5453-4ab4-8393-7cf2c6120ba3" returned: 0 in 0.678s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Performing cascade delete. {{(pid=83712) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-69214c46-5453-4ab4-8393-7cf2c6120ba3" released by "_delete_snapshot" :: held 3.097s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" released by "delete_snapshot" :: held 3.128s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-e93f992f-676c-4ce2-9987-c53ae4255ee1-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-e93f992f-676c-4ce2-9987-c53ae4255ee1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:06 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:02:06 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-quobyte-8b459494-06f8-41f7-825d-8c9bd133ad60" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-8b459494-06f8-41f7-825d-8c9bd133ad60" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-quobyte-e93f992f-676c-4ce2-9987-c53ae4255ee1" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-e93f992f-676c-4ce2-9987-c53ae4255ee1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Deleting offline snapshot e93f992f-676c-4ce2-9987-c53ae4255ee1 of volume 8b459494-06f8-41f7-825d-8c9bd133ad60 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] snapshot_file for this snap is: volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Created reservations ['67460b13-4fa6-40e8-8639-ce2e78dab21e', 'aea3a317-70c7-48ab-b4db-4c2e9f75e575', 'a85dd995-3c36-41b1-95e1-bb3eba7bbd7e', 'f57d8b37-36b4-4aae-bd55-651896dfebfe'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[839e373c-192e-4d84-833b-624d23a36fe2]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:06 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Delete snapshot completed successfully. Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31905f72-fcc3-4e00-b169-f53f2c90d644 tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-69214c46-5453-4ab4-8393-7cf2c6120ba3-delete_snapshot" released by "delete_snapshot" :: held 3.398s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:06 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 Apr 29 09:02:06 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:06 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.619s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:06 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Deleted volume successfully. Apr 29 09:02:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-703821a7-ca43-49f5-b921-983e0d1d46ea tempest-SnapshotMetadataTestJSON-1868293877 None] Lock "cinder-124dbaf7-ffe6-4791-aee0-3474a91eabd8-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:07 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1" returned: 0 in 0.801s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b459494-06f8-41f7-825d-8c9bd133ad60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:07 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[9953253c-f3f0-4226-999a-dbbf4fcbe27c]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:07 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 Apr 29 09:02:07 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] Creating offline snapshot 06255de1-c903-426e-a820-47243310f6cf of volume d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:02:07 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc915a5-9997-4dc3-93a8-586634b3169b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:07 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:02:07 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:08 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60" returned: 0 in 0.858s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:08 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dadb5ab-db4f-43c8-be08-f47f54368d4e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:08 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d Apr 29 09:02:08 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:08 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.786s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:08 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:08 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf 1G Apr 29 09:02:08 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:09 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d" returned: 0 in 0.873s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b459494-06f8-41f7-825d-8c9bd133ad60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:09 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa6b6f9-ecaf-4e08-86e6-18768863b187]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:09 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 Apr 29 09:02:09 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:09 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf 1G" returned: 0 in 0.892s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:09 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf Apr 29 09:02:09 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:09 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1" returned: 0 in 0.774s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b459494-06f8-41f7-825d-8c9bd133ad60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:09 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[034a902f-6284-4dc8-9871-fe253e031d0a]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:09 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 Apr 29 09:02:09 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:10 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf" returned: 0 in 0.763s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:10 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf is being set with open permissions: ugo+rw Apr 29 09:02:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:10 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf Apr 29 09:02:10 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:10 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60" returned: 0 in 0.809s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:10 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 Apr 29 09:02:10 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:10 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf" returned: 0 in 0.692s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.264s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:10 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a9dbf084-3cd5-4e43-b02e-b59246b1c698 tempest-SnapshotsActionsTest-1944189273 None] Create snapshot completed successfully Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Flow 'volume_create_manager' (9cdec1b2-dd64-4b3d-b1df-db0f48520094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6eb410-4b9f-42f8-aee1-cbb3d0c5ddcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6eb410-4b9f-42f8-aee1-cbb3d0c5ddcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1641329844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9319aebc-7d6a-4b51-8716-572460bd7b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5618cfc8b34f43e5a5be45ed45d40e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:11Z,use_quota=True,user_id='7b1185e795394d9fb28ed87607a8cb34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df73e321-6341-4dc0-aa5a-c2d61e24944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df73e321-6341-4dc0-aa5a-c2d61e24944b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b0401f-e985-4790-9195-b8ee131adece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b0401f-e985-4790-9195-b8ee131adece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9319aebc-7d6a-4b51-8716-572460bd7b1e', 'volume_name': 'volume-9319aebc-7d6a-4b51-8716-572460bd7b1e', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d39ff3-f5e8-4698-810e-cb96974c94ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d39ff3-f5e8-4698-810e-cb96974c94ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5946af7d-2628-43ca-9614-f9879790604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:11 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Volume 9319aebc-7d6a-4b51-8716-572460bd7b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9319aebc-7d6a-4b51-8716-572460bd7b1e', 'volume_size': 1} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1641329844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9319aebc-7d6a-4b51-8716-572460bd7b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5618cfc8b34f43e5a5be45ed45d40e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:11Z,use_quota=True,user_id='7b1185e795394d9fb28ed87607a8cb34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Creating volume 9319aebc-7d6a-4b51-8716-572460bd7b1e {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:02:11 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9319aebc-7d6a-4b51-8716-572460bd7b1e 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:11 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:11 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9319aebc-7d6a-4b51-8716-572460bd7b1e 1073741824 Apr 29 09:02:11 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1" returned: 0 in 0.771s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:11 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1 Apr 29 09:02:11 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Acquiring lock "cinder-06255de1-c903-426e-a820-47243310f6cf-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-06255de1-c903-426e-a820-47243310f6cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Acquiring lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Acquiring lock "cinder-quobyte-06255de1-c903-426e-a820-47243310f6cf" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:12 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.e93f992f-676c-4ce2-9987-c53ae4255ee1" returned: 0 in 0.630s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b459494-06f8-41f7-825d-8c9bd133ad60 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d -F qcow2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-06255de1-c903-426e-a820-47243310f6cf" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Deleting offline snapshot 06255de1-c903-426e-a820-47243310f6cf of volume d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:02:12 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b459494-06f8-41f7-825d-8c9bd133ad60 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d -F qcow2 Apr 29 09:02:12 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] snapshot_file for this snap is: volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[043a9870-8903-40c3-b4a8-3ef32bf243ec]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:12 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf Apr 29 09:02:12 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:12 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9319aebc-7d6a-4b51-8716-572460bd7b1e 1073741824" returned: 0 in 1.013s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9319aebc-7d6a-4b51-8716-572460bd7b1e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:12 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9319aebc-7d6a-4b51-8716-572460bd7b1e Apr 29 09:02:12 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:12 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b459494-06f8-41f7-825d-8c9bd133ad60 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d -F qcow2" returned: 0 in 0.719s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-e93f992f-676c-4ce2-9987-c53ae4255ee1" released by "_delete_snapshot" :: held 6.454s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-8b459494-06f8-41f7-825d-8c9bd133ad60" released by "delete_snapshot" :: held 6.492s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Created reservations ['e56a52bc-fe2a-45ce-994d-57b1089bb614', '688c850f-fa03-4212-a5c7-fffcbe25e166', '4e186168-c937-4475-ac83-1a5d8ae83745', '9c603c3e-5f4e-48e1-ad6e-a80b89d91e25'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:12 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf" returned: 0 in 0.837s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:13 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Delete snapshot completed successfully. Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a91f7c-b362-45e5-af87-56aa1160ba94]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-e93f992f-676c-4ce2-9987-c53ae4255ee1-delete_snapshot" released by "delete_snapshot" :: held 6.737s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-eb2eac39-105c-468a-b134-57f208ab584d-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-eb2eac39-105c-468a-b134-57f208ab584d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-quobyte-8b459494-06f8-41f7-825d-8c9bd133ad60" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-8b459494-06f8-41f7-825d-8c9bd133ad60" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-quobyte-eb2eac39-105c-468a-b134-57f208ab584d" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-eb2eac39-105c-468a-b134-57f208ab584d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Deleting offline snapshot eb2eac39-105c-468a-b134-57f208ab584d of volume 8b459494-06f8-41f7-825d-8c9bd133ad60 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] snapshot_file for this snap is: volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1571a76-2e83-4631-93fc-38d57affc6b3]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:13 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:02:13 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:13 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9319aebc-7d6a-4b51-8716-572460bd7b1e" returned: 0 in 0.749s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5946af7d-2628-43ca-9614-f9879790604a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9319aebc-7d6a-4b51-8716-572460bd7b1e', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e9c64e-2a78-4f05-9acb-814c693788f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:13 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Volume volume-9319aebc-7d6a-4b51-8716-572460bd7b1e (9319aebc-7d6a-4b51-8716-572460bd7b1e): created successfully Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e9c64e-2a78-4f05-9acb-814c693788f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Flow 'volume_create_manager' (9cdec1b2-dd64-4b3d-b1df-db0f48520094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:13 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d Apr 29 09:02:13 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:13 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-47fdf9da-41b8-46ed-97ef-40e829cdfc75 tempest-VolumesTransfersV355Test-1860130583 None] Created volume successfully. Apr 29 09:02:13 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.862s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:13 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf Apr 29 09:02:13 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:13 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d" returned: 0 in 0.783s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b459494-06f8-41f7-825d-8c9bd133ad60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e22469-46cc-4c56-ba93-f7904fbbdf61]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:14 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 Apr 29 09:02:14 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:14 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60" returned: 0 in 0.808s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:14 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf" returned: 0 in 0.925s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:14 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d Apr 29 09:02:14 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:14 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf Apr 29 09:02:14 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:15 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-09c47047-6b28-400e-9a75-a282b3b8f9f5 tempest-VolumesTransfersV355Test-2031311958 None] Transfer volume completed successfully. Apr 29 09:02:15 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.06255de1-c903-426e-a820-47243310f6cf" returned: 0 in 0.675s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-06255de1-c903-426e-a820-47243310f6cf" released by "_delete_snapshot" :: held 3.407s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" released by "delete_snapshot" :: held 3.454s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:15 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Created reservations ['16eee4d7-fec5-43fc-a676-0436fb31f670', '25608967-449f-410f-acac-babcdb493f9b', 'ae1190ea-0c7d-40de-bd73-6908e394b708', '8bce31cd-1b2e-48d6-99c4-e17f61868d55'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:15 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d" returned: 0 in 0.859s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:15 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Delete snapshot completed successfully. Apr 29 09:02:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-32c4b34e-8648-40ac-b021-d9deea834f13 tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-06255de1-c903-426e-a820-47243310f6cf-delete_snapshot" released by "delete_snapshot" :: held 3.625s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:15 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d Apr 29 09:02:15 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Acquiring lock "cinder-9319aebc-7d6a-4b51-8716-572460bd7b1e-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Lock "cinder-9319aebc-7d6a-4b51-8716-572460bd7b1e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Acquiring lock "cinder-quobyte-9319aebc-7d6a-4b51-8716-572460bd7b1e" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Lock "cinder-quobyte-9319aebc-7d6a-4b51-8716-572460bd7b1e" acquired by "delete_volume" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[b001a33e-df14-4b5d-bcee-2d2d83dd5ff0]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9319aebc-7d6a-4b51-8716-572460bd7b1e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:16 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60.eb2eac39-105c-468a-b134-57f208ab584d" returned: 0 in 0.681s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-eb2eac39-105c-468a-b134-57f208ab584d" released by "_delete_snapshot" :: held 3.249s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-8b459494-06f8-41f7-825d-8c9bd133ad60" released by "delete_snapshot" :: held 3.277s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:16 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9319aebc-7d6a-4b51-8716-572460bd7b1e Apr 29 09:02:16 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Created reservations ['5cf63313-f480-4001-ba3a-2ee14540c465', '0c386bab-1262-4fed-8fdf-4e6762bc8cd0', '052a625b-c56c-4252-8405-ec8975d764d6', '3e31abb2-f402-4f87-99f0-e45d2508affb'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:16 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Delete snapshot completed successfully. Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-eb2eac39-105c-468a-b134-57f208ab584d-delete_snapshot" released by "delete_snapshot" :: held 3.476s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Snapshots deleted, issuing volume delete {{(pid=83712) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-quobyte-8b459494-06f8-41f7-825d-8c9bd133ad60" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-8b459494-06f8-41f7-825d-8c9bd133ad60" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[df787f97-9d29-43c9-ba23-d5f566e1ca94]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] Creating offline snapshot 806a3970-aedc-48ec-b8c8-0465d54ccdc0 of volume d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:02:16 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 Apr 29 09:02:16 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[b067eaae-4a6c-4755-bffe-21dab875dc37]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:16 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:02:16 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:17 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9319aebc-7d6a-4b51-8716-572460bd7b1e" returned: 0 in 0.851s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9319aebc-7d6a-4b51-8716-572460bd7b1e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:17 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9319aebc-7d6a-4b51-8716-572460bd7b1e Apr 29 09:02:17 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:17 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60" returned: 0 in 0.802s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:17 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60 Apr 29 09:02:17 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:17 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.755s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:17 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 1G Apr 29 09:02:17 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:17 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9319aebc-7d6a-4b51-8716-572460bd7b1e" returned: 0 in 0.652s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Lock "cinder-quobyte-9319aebc-7d6a-4b51-8716-572460bd7b1e" released by "delete_volume" :: held 1.571s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Created reservations ['b59383f5-5ff3-4967-834f-9c9b04af5e46', 'c8dee438-0a56-4653-8859-1c068e38951c', '538261cc-7aeb-4eb0-82a2-db1ddc674ee2', '9806611f-19e3-40d3-87b2-e0d3e9c7e768'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:17 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:02:17 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:18 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b459494-06f8-41f7-825d-8c9bd133ad60" returned: 0 in 0.625s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-8b459494-06f8-41f7-825d-8c9bd133ad60" released by "delete_volume" :: held 1.505s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Created reservations ['24b2471f-df65-469a-88c1-ea6167de1cea', '4d38131f-c1a1-4ecd-b7b3-adca5951c1a8', '61e9308a-4feb-480f-8786-0b26715fe84f', '0b44cc73-eb0e-4efa-88c1-081acac3644f'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:18 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:02:18 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:18 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 1G" returned: 0 in 0.857s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:18 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 Apr 29 09:02:18 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:18 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.687s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:18 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Deleted volume successfully. Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7d162d09-7630-43f3-bb87-a2d6e446af9e tempest-VolumesTransfersV355Test-184548693 None] Lock "cinder-9319aebc-7d6a-4b51-8716-572460bd7b1e-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:18 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.720s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:18 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Deleted volume successfully. Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8b2232b0-1ded-463c-82e0-410ccf0d8b2e tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-8b459494-06f8-41f7-825d-8c9bd133ad60-delete_volume" released by "delete_volume" :: held 12.782s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:18 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Flow 'volume_create_manager' (1bbe8303-da47-4c9f-b5a6-300e2d61fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636e80cb-6eee-4ad9-a788-850afa16957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636e80cb-6eee-4ad9-a788-850afa16957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1960141624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6818be80-92d7-4286-8fed-fb60dbf7dac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5618cfc8b34f43e5a5be45ed45d40e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:19Z,use_quota=True,user_id='7b1185e795394d9fb28ed87607a8cb34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a83fc9b-0578-4e63-9af1-800694ed075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a83fc9b-0578-4e63-9af1-800694ed075b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7a0d84-aa61-4022-bcc4-e0c7b5fc57ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7a0d84-aa61-4022-bcc4-e0c7b5fc57ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6818be80-92d7-4286-8fed-fb60dbf7dac6', 'volume_name': 'volume-6818be80-92d7-4286-8fed-fb60dbf7dac6', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:19 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165f4ccb-de04-4c61-9b3f-c66abbd6587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165f4ccb-de04-4c61-9b3f-c66abbd6587d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd062754-d09c-49b4-8d52-93d11a7e1fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:19 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Volume 6818be80-92d7-4286-8fed-fb60dbf7dac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6818be80-92d7-4286-8fed-fb60dbf7dac6', 'volume_size': 1} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0" returned: 0 in 0.703s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:19 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 is being set with open permissions: ugo+rw Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:19 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 Apr 29 09:02:19 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Flow 'volume_create_manager' (001dadc2-1f38-4ebf-b94e-d9aa35fcf486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:19 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3a0769-56ce-4b54-84f9-472a88b431f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0" returned: 0 in 0.678s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3a0769-56ce-4b54-84f9-472a88b431f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-295455120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c907c0ac-0002-40ff-8706-22a94c76bf34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1538639263d640e9972dd08e7bc41470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:20Z,use_quota=True,user_id='149deef4625c488aa380fb161ddfe6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94068c71-a06c-45a5-bbda-3acdfb3b0cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94068c71-a06c-45a5-bbda-3acdfb3b0cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85344084-bc47-4b07-a8a8-129b85f200ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85344084-bc47-4b07-a8a8-129b85f200ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c907c0ac-0002-40ff-8706-22a94c76bf34', 'volume_name': 'volume-c907c0ac-0002-40ff-8706-22a94c76bf34', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd170b76-2b48-40a6-8ecf-3381abf9207e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd170b76-2b48-40a6-8ecf-3381abf9207e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cffcfa-e0b0-4ea0-828e-8600a0bde019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:19 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Volume c907c0ac-0002-40ff-8706-22a94c76bf34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c907c0ac-0002-40ff-8706-22a94c76bf34', 'volume_size': 1} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.144s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1960141624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6818be80-92d7-4286-8fed-fb60dbf7dac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5618cfc8b34f43e5a5be45ed45d40e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:19Z,use_quota=True,user_id='7b1185e795394d9fb28ed87607a8cb34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Creating volume 6818be80-92d7-4286-8fed-fb60dbf7dac6 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:02:19 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:02:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6818be80-92d7-4286-8fed-fb60dbf7dac6 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:19 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6818be80-92d7-4286-8fed-fb60dbf7dac6 1073741824 Apr 29 09:02:19 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:19 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f887adf5-3765-4087-b78a-493aad3d3e28 tempest-SnapshotsActionsTest-1944189273 None] Create snapshot completed successfully Apr 29 09:02:20 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6818be80-92d7-4286-8fed-fb60dbf7dac6 1073741824" returned: 0 in 0.833s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6818be80-92d7-4286-8fed-fb60dbf7dac6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:20 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6818be80-92d7-4286-8fed-fb60dbf7dac6 Apr 29 09:02:20 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Acquiring lock "cinder-806a3970-aedc-48ec-b8c8-0465d54ccdc0-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-806a3970-aedc-48ec-b8c8-0465d54ccdc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Acquiring lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Acquiring lock "cinder-quobyte-806a3970-aedc-48ec-b8c8-0465d54ccdc0" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-806a3970-aedc-48ec-b8c8-0465d54ccdc0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Deleting offline snapshot 806a3970-aedc-48ec-b8c8-0465d54ccdc0 of volume d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] snapshot_file for this snap is: volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[176e8ee9-e89f-4b16-95ad-865d94f157be]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:21 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 Apr 29 09:02:21 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:21 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6818be80-92d7-4286-8fed-fb60dbf7dac6" returned: 0 in 0.644s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-295455120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c907c0ac-0002-40ff-8706-22a94c76bf34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1538639263d640e9972dd08e7bc41470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:20Z,use_quota=True,user_id='149deef4625c488aa380fb161ddfe6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Creating volume c907c0ac-0002-40ff-8706-22a94c76bf34 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:02:21 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd062754-d09c-49b4-8d52-93d11a7e1fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6818be80-92d7-4286-8fed-fb60dbf7dac6', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:21 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 1073741824 Apr 29 09:02:21 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca5802d-39d6-45be-a668-9aaa9c869075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:21 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Volume volume-6818be80-92d7-4286-8fed-fb60dbf7dac6 (6818be80-92d7-4286-8fed-fb60dbf7dac6): created successfully Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca5802d-39d6-45be-a668-9aaa9c869075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Flow 'volume_create_manager' (1bbe8303-da47-4c9f-b5a6-300e2d61fe80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:21 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6ada69a2-b92d-4438-b2e1-9a24ed2f2ddd tempest-VolumesTransfersV355Test-1860130583 None] Created volume successfully. Apr 29 09:02:21 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0" returned: 0 in 0.829s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[42156945-6148-4130-a210-0ef777d0addf]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:22 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:02:22 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:22 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 1073741824" returned: 0 in 0.797s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:22 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 Apr 29 09:02:22 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Acquiring lock "cinder-6818be80-92d7-4286-8fed-fb60dbf7dac6-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Lock "cinder-6818be80-92d7-4286-8fed-fb60dbf7dac6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Acquiring lock "cinder-quobyte-6818be80-92d7-4286-8fed-fb60dbf7dac6" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Lock "cinder-quobyte-6818be80-92d7-4286-8fed-fb60dbf7dac6" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eaa319-bb1a-46de-8247-40ef820b28c0]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6818be80-92d7-4286-8fed-fb60dbf7dac6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:22 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6818be80-92d7-4286-8fed-fb60dbf7dac6 Apr 29 09:02:22 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:22 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.946s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:22 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34" returned: 0 in 0.731s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:22 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 Apr 29 09:02:22 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cffcfa-e0b0-4ea0-828e-8600a0bde019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c907c0ac-0002-40ff-8706-22a94c76bf34', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b6eb66-0f66-4de1-ac45-64295af66c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:22 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Volume volume-c907c0ac-0002-40ff-8706-22a94c76bf34 (c907c0ac-0002-40ff-8706-22a94c76bf34): created successfully Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b6eb66-0f66-4de1-ac45-64295af66c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Flow 'volume_create_manager' (001dadc2-1f38-4ebf-b94e-d9aa35fcf486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:23 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d5524675-75b8-4b9d-8d32-2946c6ad35fe tempest-VolumesDeleteCascade-112774499 None] Created volume successfully. Apr 29 09:02:23 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6818be80-92d7-4286-8fed-fb60dbf7dac6" returned: 0 in 0.824s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6818be80-92d7-4286-8fed-fb60dbf7dac6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:23 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6818be80-92d7-4286-8fed-fb60dbf7dac6 Apr 29 09:02:23 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:23 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0" returned: 0 in 0.809s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:23 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0 Apr 29 09:02:23 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] Creating offline snapshot 297547a3-a077-40a1-a5f3-f94066cff29f of volume c907c0ac-0002-40ff-8706-22a94c76bf34 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6ebd00-6973-4aa6-88b7-76904adc4294]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:24 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6818be80-92d7-4286-8fed-fb60dbf7dac6" returned: 0 in 0.736s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Lock "cinder-quobyte-6818be80-92d7-4286-8fed-fb60dbf7dac6" released by "delete_volume" :: held 1.610s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Created reservations ['9eb32d9c-3e14-42ad-9455-5b59edec2bb8', '00203176-5cad-41a4-850f-88fb0766f211', '896b2a41-7db1-4a71-8688-645126637dd1', 'f3c45555-e49c-40c5-9f20-ac541fcfabfc'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:24 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 Apr 29 09:02:24 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:24 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.806a3970-aedc-48ec-b8c8-0465d54ccdc0" returned: 0 in 0.734s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:24 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:02:24 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-806a3970-aedc-48ec-b8c8-0465d54ccdc0" released by "_delete_snapshot" :: held 3.437s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" released by "delete_snapshot" :: held 3.464s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Created reservations ['43891c84-99e4-447c-9f0c-f4597e8f957f', '535aab02-9b6c-417f-8376-79a9a537f11f', '6acc2cfe-fbb3-4d33-a42e-12f49c21327f', '8543f079-9713-4197-a86d-5e3a691b1742'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:24 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Delete snapshot completed successfully. Apr 29 09:02:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e39819fa-7621-49df-b6ed-efdae2b90b1b tempest-SnapshotsActionsTest-108817886 None] Lock "cinder-806a3970-aedc-48ec-b8c8-0465d54ccdc0-delete_snapshot" released by "delete_snapshot" :: held 3.614s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:25 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.690s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:25 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Deleted volume successfully. Apr 29 09:02:25 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34" returned: 0 in 0.890s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bf90a26f-c292-46c7-b974-90847fb57b65 tempest-VolumesTransfersV355Test-184548693 None] Lock "cinder-6818be80-92d7-4286-8fed-fb60dbf7dac6-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:25 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f 1G Apr 29 09:02:25 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "cinder-24c592d7-fd32-485a-80d4-f9f65599b750-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Lock "cinder-24c592d7-fd32-485a-80d4-f9f65599b750-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "cinder-quobyte-24c592d7-fd32-485a-80d4-f9f65599b750" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Lock "cinder-quobyte-24c592d7-fd32-485a-80d4-f9f65599b750" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Deleting offline snapshot 24c592d7-fd32-485a-80d4-f9f65599b750 of volume d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] snapshot_file for this snap is: volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1d4b9e-d9ba-4b1c-9bd3-dd44e6c49ffc]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:26 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:02:26 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:26 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f 1G" returned: 0 in 0.941s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c907c0ac-0002-40ff-8706-22a94c76bf34 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:26 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c907c0ac-0002-40ff-8706-22a94c76bf34 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f Apr 29 09:02:26 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:26 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.883s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:26 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fde8e8a-30f9-4081-b56f-fdc0c2dae9ea]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:26 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c907c0ac-0002-40ff-8706-22a94c76bf34 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f" returned: 0 in 0.788s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:26 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f is being set with open permissions: ugo+rw Apr 29 09:02:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:26 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f Apr 29 09:02:26 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:26 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb Apr 29 09:02:26 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:27 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f" returned: 0 in 0.655s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:27 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.info Apr 29 09:02:27 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:27 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" returned: 0 in 0.955s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:27 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:02:27 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:28 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.info" returned: 0 in 0.621s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:28 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.info is being set with open permissions: ugo+rw Apr 29 09:02:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:28 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.info Apr 29 09:02:28 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:28 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.916s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:28 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750 Apr 29 09:02:28 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:28 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.info" returned: 0 in 0.736s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.739s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:29 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-750b8ebb-37f1-457c-9291-6aef1d60f9d5 tempest-VolumesDeleteCascade-112774499 None] Create snapshot completed successfully Apr 29 09:02:29 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb.24c592d7-fd32-485a-80d4-f9f65599b750" returned: 0 in 0.783s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Lock "cinder-quobyte-24c592d7-fd32-485a-80d4-f9f65599b750" released by "_delete_snapshot" :: held 3.672s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" released by "delete_snapshot" :: held 3.707s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:29 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Created reservations ['5930961d-022b-4b17-a97c-a798c5b78b6b', 'c1597440-8f8c-4458-be70-8d446af7fcf4', '4f3441c5-bf55-42ad-8d7a-c839b3b390df', 'fcf187a3-1143-4839-80a6-4a7eee635853'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:29 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Delete snapshot completed successfully. Apr 29 09:02:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1187e30c-734f-4bd5-b7bb-52dafab98462 tempest-SnapshotsActionsTest-1944189273 None] Lock "cinder-24c592d7-fd32-485a-80d4-f9f65599b750-delete_snapshot" released by "delete_snapshot" :: held 3.918s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Flow 'volume_create_manager' (61cb5649-ce77-462d-8b07-e6654b4834bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5e665c-7059-4084-adf7-3cb208c601c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5e665c-7059-4084-adf7-3cb208c601c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-561423864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd51da0-5846-4d51-9966-8699d3160938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1538639263d640e9972dd08e7bc41470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=297547a3-a077-40a1-a5f3-f94066cff29f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:30Z,use_quota=True,user_id='149deef4625c488aa380fb161ddfe6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98e92ce-9c1a-4b3a-b3fc-1996577afa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98e92ce-9c1a-4b3a-b3fc-1996577afa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be932330-1e2b-480f-9bd3-2909691a806d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be932330-1e2b-480f-9bd3-2909691a806d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fbd51da0-5846-4d51-9966-8699d3160938', 'volume_name': 'volume-fbd51da0-5846-4d51-9966-8699d3160938', 'volume_size': 1, 'snapshot_id': '297547a3-a077-40a1-a5f3-f94066cff29f'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7302fbc5-166c-44c7-92fb-08efb8b67a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7302fbc5-166c-44c7-92fb-08efb8b67a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1c8896-1f84-45cd-abac-522e765dc35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:30 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Volume fbd51da0-5846-4d51-9966-8699d3160938: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fbd51da0-5846-4d51-9966-8699d3160938', 'volume_size': 1, 'snapshot_id': '297547a3-a077-40a1-a5f3-f94066cff29f'} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "cinder-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-quobyte-297547a3-a077-40a1-a5f3-f94066cff29f-fbd51da0-5846-4d51-9966-8699d3160938" by "_create_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-297547a3-a077-40a1-a5f3-f94066cff29f-fbd51da0-5846-4d51-9966-8699d3160938" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Creating volume fbd51da0-5846-4d51-9966-8699d3160938 from snapshot 297547a3-a077-40a1-a5f3-f94066cff29f {{(pid=83712) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-quobyte-fbd51da0-5846-4d51-9966-8699d3160938" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Lock "cinder-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-fbd51da0-5846-4d51-9966-8699d3160938" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] snapshot: 297547a3-a077-40a1-a5f3-f94066cff29f, volume: fbd51da0-5846-4d51-9966-8699d3160938, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a145ed-4019-458a-90df-40877444606f]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[66773126-9abd-40fd-93b0-a68419538cd3]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:30 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f Apr 29 09:02:30 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:30 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb Apr 29 09:02:30 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:31 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f" returned: 0 in 0.783s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c907c0ac-0002-40ff-8706-22a94c76bf34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[452de8a4-5276-4bcc-9f2b-ec1600e69fa7]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:31 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" returned: 0 in 0.861s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:31 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb Apr 29 09:02:31 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:31 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 Apr 29 09:02:31 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:31 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" returned: 0 in 0.614s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Lock "cinder-quobyte-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb" released by "delete_volume" :: held 1.559s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Created reservations ['9563a53b-4ae7-4213-837b-78a5c8f37e52', '28a04823-a659-4da8-8486-09aed594d4cb', '8c34a485-21cb-4498-961d-89b78d7131ee', '6fef2643-f0a8-42d2-802a-b8c9c03dade2'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:31 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34" returned: 0 in 0.841s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938 not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:31 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938 Apr 29 09:02:31 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:32 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:02:32 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:32 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.728s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:32 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:32 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Deleted volume successfully. Apr 29 09:02:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ccad8684-a943-4896-9444-f482e0ad3eba tempest-SnapshotsActionsTest-1944189273 None] Lock "cinder-d4abb64c-9b7a-48b7-a10e-f29a0dd3e1fb-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:32 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:02:32 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Flow 'volume_create_manager' (2b7c6971-1770-4564-9660-087fdba93515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:32 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab75e0a-f347-4554-bea1-82f85a1229db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:33 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab75e0a-f347-4554-bea1-82f85a1229db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1928091723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044c4556-95ca-4945-8861-f2b5bdcc890a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64767930d5e347fcaccd05752418899c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:33Z,use_quota=True,user_id='5896abd74ad74ea186d4e43d4cfbb615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:33 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0de6f3-3c8f-4d65-9ebe-ecde49f4d6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:33 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0de6f3-3c8f-4d65-9ebe-ecde49f4d6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:33 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea24bfe-8543-436f-807b-7e2ce15cb6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:33 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea24bfe-8543-436f-807b-7e2ce15cb6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '044c4556-95ca-4945-8861-f2b5bdcc890a', 'volume_name': 'volume-044c4556-95ca-4945-8861-f2b5bdcc890a', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:33 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4364692-19a8-4d46-a313-5a070bded5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:33 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4364692-19a8-4d46-a313-5a070bded5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:33 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d999ac8-e9f3-440e-bd25-a54dc87bcb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:33 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Volume 044c4556-95ca-4945-8861-f2b5bdcc890a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-044c4556-95ca-4945-8861-f2b5bdcc890a', 'volume_size': 1} Apr 29 09:02:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:37 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938" returned: 0 in 6.048s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:38 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e14437-d562-43ad-b11d-3d086b55cf48]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:38 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 Apr 29 09:02:38 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:38 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34" returned: 0 in 0.880s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:38 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938 {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:02:38 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Converted 1024.00 MB image at 169.28 MB/s Apr 29 09:02:38 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938 is being set with open permissions: ugo+rw Apr 29 09:02:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:38 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938 Apr 29 09:02:38 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:39 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938" returned: 0 in 0.709s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-fbd51da0-5846-4d51-9966-8699d3160938" released by "_copy_volume_from_snapshot" :: held 9.432s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-297547a3-a077-40a1-a5f3-f94066cff29f-fbd51da0-5846-4d51-9966-8699d3160938" released by "_create_volume_from_snapshot" :: held 9.477s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.497s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.447s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1928091723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044c4556-95ca-4945-8861-f2b5bdcc890a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64767930d5e347fcaccd05752418899c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:33Z,use_quota=True,user_id='5896abd74ad74ea186d4e43d4cfbb615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Creating volume 044c4556-95ca-4945-8861-f2b5bdcc890a {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:02:39 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-044c4556-95ca-4945-8861-f2b5bdcc890a 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=120,cinder:UPDATE=126,cinder:INSERT=30,cinder:DELETE=7 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=115,cinder:UPDATE=140,cinder:DELETE=14,cinder:INSERT=42 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:02:39 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-044c4556-95ca-4945-8861-f2b5bdcc890a 1073741824 Apr 29 09:02:39 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1c8896-1f84-45cd-abac-522e765dc35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd51da0-5846-4d51-9966-8699d3160938', 'volume_size': 1, 'snapshot_id': '297547a3-a077-40a1-a5f3-f94066cff29f'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7fd894d-5ad8-4536-b797-4a17315bb3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:39 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Volume volume-fbd51da0-5846-4d51-9966-8699d3160938 (fbd51da0-5846-4d51-9966-8699d3160938): created successfully Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7fd894d-5ad8-4536-b797-4a17315bb3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Flow 'volume_create_manager' (61cb5649-ce77-462d-8b07-e6654b4834bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:39 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6695fc28-408a-4672-8088-79ee8fff0ddc tempest-VolumesDeleteCascade-112774499 None] Created volume successfully. Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-c907c0ac-0002-40ff-8706-22a94c76bf34-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-c907c0ac-0002-40ff-8706-22a94c76bf34-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Performing cascade delete. {{(pid=83712) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-297547a3-a077-40a1-a5f3-f94066cff29f-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-297547a3-a077-40a1-a5f3-f94066cff29f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-quobyte-c907c0ac-0002-40ff-8706-22a94c76bf34" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-c907c0ac-0002-40ff-8706-22a94c76bf34" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-quobyte-297547a3-a077-40a1-a5f3-f94066cff29f" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-297547a3-a077-40a1-a5f3-f94066cff29f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Deleting offline snapshot 297547a3-a077-40a1-a5f3-f94066cff29f of volume c907c0ac-0002-40ff-8706-22a94c76bf34 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] snapshot_file for this snap is: volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b53d96-64bc-4546-a17c-5b97551a8632]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:40 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-044c4556-95ca-4945-8861-f2b5bdcc890a 1073741824" returned: 0 in 1.015s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-044c4556-95ca-4945-8861-f2b5bdcc890a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:40 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f Apr 29 09:02:40 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:40 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-044c4556-95ca-4945-8861-f2b5bdcc890a Apr 29 09:02:40 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Flow 'volume_create_manager' (f1bbfc63-8d27-4e12-b657-ba556325b986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9eb481-29c9-41d4-8a93-896c6be6c689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9eb481-29c9-41d4-8a93-896c6be6c689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-761801275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36339a71-6090-4986-b8eb-fd0a9aac7ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2444ffc9d04823a44cd9dfc04b0803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:41Z,use_quota=True,user_id='c1c8a9fe7f0a4325a696f0f5cba96050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(670c2df5-1c35-4831-8efc-939ee0cf0a4d),volume_type_id=670c2df5-1c35-4831-8efc-939ee0cf0a4d)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc46f43-27ba-4637-9412-8e7cd7de0d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc46f43-27ba-4637-9412-8e7cd7de0d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bda02a7-e4c1-48a7-96a1-6840d3dc4c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bda02a7-e4c1-48a7-96a1-6840d3dc4c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36339a71-6090-4986-b8eb-fd0a9aac7ba9', 'volume_name': 'volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051058c8-278a-4c13-9358-f4a658f31d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051058c8-278a-4c13-9358-f4a658f31d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24fb8fa-cff6-46c3-803a-2ebd5b5477a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:41 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Volume 36339a71-6090-4986-b8eb-fd0a9aac7ba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9', 'volume_size': 1} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:41 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-044c4556-95ca-4945-8861-f2b5bdcc890a" returned: 0 in 0.709s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.278s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-761801275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36339a71-6090-4986-b8eb-fd0a9aac7ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2444ffc9d04823a44cd9dfc04b0803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:41Z,use_quota=True,user_id='c1c8a9fe7f0a4325a696f0f5cba96050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(670c2df5-1c35-4831-8efc-939ee0cf0a4d),volume_type_id=670c2df5-1c35-4831-8efc-939ee0cf0a4d)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Creating volume 36339a71-6090-4986-b8eb-fd0a9aac7ba9 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:02:41 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:41 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d999ac8-e9f3-440e-bd25-a54dc87bcb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-044c4556-95ca-4945-8861-f2b5bdcc890a', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1174f8-5f0d-4974-b820-a6247c77b95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:41 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9 1073741824 Apr 29 09:02:41 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f" returned: 0 in 0.886s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c907c0ac-0002-40ff-8706-22a94c76bf34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:02:41 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Volume volume-044c4556-95ca-4945-8861-f2b5bdcc890a (044c4556-95ca-4945-8861-f2b5bdcc890a): created successfully Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1174f8-5f0d-4974-b820-a6247c77b95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Flow 'volume_create_manager' (2b7c6971-1770-4564-9660-087fdba93515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0daf361-635a-4b78-b405-6dc70c442fdf]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:41 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-82ece7c0-68f8-45cc-bfda-1589b4bad556 tempest-VolumesTransfersV357Test-2038311791 None] Created volume successfully. Apr 29 09:02:41 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 Apr 29 09:02:41 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:42 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9 1073741824" returned: 0 in 0.919s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:42 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9 Apr 29 09:02:42 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:42 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34" returned: 0 in 0.960s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:42 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f Apr 29 09:02:42 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:42 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-aa8e195e-2c04-44d7-8c2e-66971d465af4 tempest-VolumesTransfersV357Test-15938938 None] Transfer volume completed successfully. Apr 29 09:02:43 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9" returned: 0 in 0.689s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24fb8fa-cff6-46c3-803a-2ebd5b5477a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682a8e26-5944-4424-8752-3e2a2112bf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:43 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Volume volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9 (36339a71-6090-4986-b8eb-fd0a9aac7ba9): created successfully Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682a8e26-5944-4424-8752-3e2a2112bf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Flow 'volume_create_manager' (f1bbfc63-8d27-4e12-b657-ba556325b986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:43 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-30388d9c-066d-4579-bc5a-318186197dbb tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Created volume successfully. Apr 29 09:02:43 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f" returned: 0 in 0.838s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:43 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f Apr 29 09:02:43 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Acquiring lock "cinder-044c4556-95ca-4945-8861-f2b5bdcc890a-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Lock "cinder-044c4556-95ca-4945-8861-f2b5bdcc890a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Acquiring lock "cinder-quobyte-044c4556-95ca-4945-8861-f2b5bdcc890a" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Lock "cinder-quobyte-044c4556-95ca-4945-8861-f2b5bdcc890a" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6977e6d-c1b9-4ed2-a51a-3b31d9bccaa3]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-044c4556-95ca-4945-8861-f2b5bdcc890a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:43 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-044c4556-95ca-4945-8861-f2b5bdcc890a Apr 29 09:02:43 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:43 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34.297547a3-a077-40a1-a5f3-f94066cff29f" returned: 0 in 0.624s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-297547a3-a077-40a1-a5f3-f94066cff29f" released by "_delete_snapshot" :: held 3.453s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-c907c0ac-0002-40ff-8706-22a94c76bf34" released by "delete_snapshot" :: held 3.485s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Created reservations ['6073f4f8-1855-446b-a4ab-665fded44216', 'dc33a079-adf6-4dbd-bbb6-06427369d102', '36a1fc7a-53ba-4a8a-af4f-85b7bcca84a8', 'd8310c03-94f4-4f7d-9c1d-0c8756c2731b'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:44 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Delete snapshot completed successfully. Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-297547a3-a077-40a1-a5f3-f94066cff29f-delete_snapshot" released by "delete_snapshot" :: held 3.647s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Snapshots deleted, issuing volume delete {{(pid=83712) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-quobyte-c907c0ac-0002-40ff-8706-22a94c76bf34" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-c907c0ac-0002-40ff-8706-22a94c76bf34" acquired by "delete_volume" :: waited 0.014s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a64bce-9e70-4315-a928-069fd9b1b022]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:44 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 Apr 29 09:02:44 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:44 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-044c4556-95ca-4945-8861-f2b5bdcc890a" returned: 0 in 0.859s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-044c4556-95ca-4945-8861-f2b5bdcc890a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:44 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-044c4556-95ca-4945-8861-f2b5bdcc890a Apr 29 09:02:44 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2a71d28b-e912-4a0c-9992-5b1e9de5ae2a tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2a71d28b-e912-4a0c-9992-5b1e9de5ae2a tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2a71d28b-e912-4a0c-9992-5b1e9de5ae2a tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2a71d28b-e912-4a0c-9992-5b1e9de5ae2a tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2a71d28b-e912-4a0c-9992-5b1e9de5ae2a tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2a71d28b-e912-4a0c-9992-5b1e9de5ae2a tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:44 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:02:44 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:45 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34" returned: 0 in 0.828s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:45 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34 Apr 29 09:02:45 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:45 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-044c4556-95ca-4945-8861-f2b5bdcc890a" returned: 0 in 0.644s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Lock "cinder-quobyte-044c4556-95ca-4945-8861-f2b5bdcc890a" released by "delete_volume" :: held 1.552s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Created reservations ['bae3a060-12b0-4e5d-91b1-b4f4bc220a88', 'b719be54-d5d6-48dd-aefd-3fba7bac13ad', '8a083021-14cb-4ca6-8f0f-0e6cb3b5a4f1', '68b17d40-a6b6-4aee-bfe4-81c23f3368fd'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:45 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:45 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2a71d28b-e912-4a0c-9992-5b1e9de5ae2a tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.662s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-2a71d28b-e912-4a0c-9992-5b1e9de5ae2a tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:45 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:45 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-2a71d28b-e912-4a0c-9992-5b1e9de5ae2a tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Retype volume completed successfully. Apr 29 09:02:45 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c907c0ac-0002-40ff-8706-22a94c76bf34" returned: 0 in 0.701s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-c907c0ac-0002-40ff-8706-22a94c76bf34" released by "delete_volume" :: held 1.596s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Created reservations ['1fffa58e-bab9-4031-8b49-a2f647bc706d', '8b2a73ee-0c38-4575-be66-0368ea6b4a74', '16ff8e72-606c-433c-bfb9-7324b6be21d5', 'ef995668-54b8-42c2-8219-a45f49903ade'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:45 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:02:45 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Acquiring lock "cinder-36339a71-6090-4986-b8eb-fd0a9aac7ba9-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:46 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.675s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Lock "cinder-36339a71-6090-4986-b8eb-fd0a9aac7ba9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:46 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Deleted volume successfully. Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-98e6898a-78a5-4561-834d-918856bc397d tempest-VolumesTransfersV357Test-65951296 None] Lock "cinder-044c4556-95ca-4945-8861-f2b5bdcc890a-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Acquiring lock "cinder-quobyte-36339a71-6090-4986-b8eb-fd0a9aac7ba9" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Lock "cinder-quobyte-36339a71-6090-4986-b8eb-fd0a9aac7ba9" acquired by "delete_volume" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d13f95-60c0-4dce-87a4-92ed5f72bb4e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-fbd51da0-5846-4d51-9966-8699d3160938-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:46 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9 Apr 29 09:02:46 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-fbd51da0-5846-4d51-9966-8699d3160938-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "cinder-quobyte-fbd51da0-5846-4d51-9966-8699d3160938" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-fbd51da0-5846-4d51-9966-8699d3160938" acquired by "delete_volume" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[171756e2-1b9e-429b-8556-41dbdd07b639]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Flow 'volume_create_manager' (c8d1d711-c5d0-4307-9f01-4b59e25ada4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:46 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938 Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84601fdd-56ec-42d0-8a05-111825650358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:46 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84601fdd-56ec-42d0-8a05-111825650358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-22234365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ac0467-6aaa-4cc6-bd1d-7aef3d43c289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64767930d5e347fcaccd05752418899c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:47Z,use_quota=True,user_id='5896abd74ad74ea186d4e43d4cfbb615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb1d9a4-885e-4324-9e32-53c9c9bdf171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb1d9a4-885e-4324-9e32-53c9c9bdf171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39391089-88b4-4b5c-9d8a-b60774cf2fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39391089-88b4-4b5c-9d8a-b60774cf2fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ac0467-6aaa-4cc6-bd1d-7aef3d43c289', 'volume_name': 'volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca3478e-abab-4d1d-8d3e-4f8e3897edd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca3478e-abab-4d1d-8d3e-4f8e3897edd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc8ef73-add0-418d-bcbf-aa175a1bc2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:46 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Volume 96ac0467-6aaa-4cc6-bd1d-7aef3d43c289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289', 'volume_size': 1} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-22234365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ac0467-6aaa-4cc6-bd1d-7aef3d43c289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64767930d5e347fcaccd05752418899c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:47Z,use_quota=True,user_id='5896abd74ad74ea186d4e43d4cfbb615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Creating volume 96ac0467-6aaa-4cc6-bd1d-7aef3d43c289 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:02:46 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:46 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289 1073741824 Apr 29 09:02:46 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:46 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.869s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:46 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Deleted volume successfully. Apr 29 09:02:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ed84af00-bad8-41d5-b03d-b281de4ba504 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-c907c0ac-0002-40ff-8706-22a94c76bf34-delete_volume" released by "delete_volume" :: held 6.415s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:47 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9" returned: 0 in 0.951s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:47 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9 Apr 29 09:02:47 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:47 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938" returned: 0 in 0.936s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:47 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938 Apr 29 09:02:47 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:47 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289 1073741824" returned: 0 in 0.967s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:47 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289 Apr 29 09:02:47 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:47 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-36339a71-6090-4986-b8eb-fd0a9aac7ba9" returned: 0 in 0.691s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Lock "cinder-quobyte-36339a71-6090-4986-b8eb-fd0a9aac7ba9" released by "delete_volume" :: held 1.697s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:47 devstack cinder-volume[83712]: WARNING cinder.quota [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:02:47 devstack cinder-volume[83712]: WARNING cinder.quota [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:02:47 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Created reservations ['afa1ff57-f158-484e-a477-5451eba60b12', '6f90d027-a1b0-4925-9812-fe1835c84e1b', '5e20dc7c-5edd-43ec-b838-e8cdcbe9e32a', '2dd9be06-1d9d-4839-82f8-ea19abe7ea6e'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:48 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:02:48 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:48 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fbd51da0-5846-4d51-9966-8699d3160938" returned: 0 in 0.665s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-quobyte-fbd51da0-5846-4d51-9966-8699d3160938" released by "delete_volume" :: held 1.663s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Created reservations ['ac45fe93-7a22-4a17-a027-507d97175430', '1c46446c-5093-4fce-831e-eb4a34ee92f7', '012a34c3-7725-4afc-981b-22f86bda7929', '27519a85-8f69-4a6e-8425-09f1e009d192'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:48 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:02:48 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:48 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289" returned: 0 in 0.681s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc8ef73-add0-418d-bcbf-aa175a1bc2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2b1a5b-45b5-420e-98bd-394dda808ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:48 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Volume volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289 (96ac0467-6aaa-4cc6-bd1d-7aef3d43c289): created successfully Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2b1a5b-45b5-420e-98bd-394dda808ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Flow 'volume_create_manager' (c8d1d711-c5d0-4307-9f01-4b59e25ada4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:48 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-090dda38-4d23-46bb-96b7-e2961bfd5256 tempest-VolumesTransfersV357Test-2038311791 None] Created volume successfully. Apr 29 09:02:48 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.704s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:48 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Deleted volume successfully. Apr 29 09:02:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a1162fcd-6c06-4ca3-9986-8e8ef6180e64 tempest-VolumeRetypeWithoutMigrationTest-1316383206 None] Lock "cinder-36339a71-6090-4986-b8eb-fd0a9aac7ba9-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:49 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.918s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:49 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:49 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Deleted volume successfully. Apr 29 09:02:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Acquiring lock "cinder-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5ad90f62-9fbd-4e94-ad65-7e18b6e3b3a6 tempest-VolumesDeleteCascade-112774499 None] Lock "cinder-fbd51da0-5846-4d51-9966-8699d3160938-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Lock "cinder-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Acquiring lock "cinder-quobyte-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Lock "cinder-quobyte-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:49 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dec5ae-a1a4-47dd-86aa-6873c203104c]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:49 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289 Apr 29 09:02:49 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:50 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289" returned: 0 in 0.939s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:50 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289 Apr 29 09:02:50 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:51 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289" returned: 0 in 0.774s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:51 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Lock "cinder-quobyte-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289" released by "delete_volume" :: held 1.770s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:51 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Created reservations ['63cd1002-52ef-483d-912d-58f259181c5b', 'b408c95d-fa60-46c6-a202-8b98b6152be4', '55b23216-2753-4a31-9b12-071ea01e9a6d', 'f868910e-af2d-4d48-842c-e622b86bf8a0'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:02:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:51 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:51 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:51 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:02:51 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:52 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.800s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:52 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:52 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Deleted volume successfully. Apr 29 09:02:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9ed076d7-1910-43cc-87ce-39023a3f8ceb tempest-VolumesTransfersV357Test-65951296 None] Lock "cinder-96ac0467-6aaa-4cc6-bd1d-7aef3d43c289-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Flow 'volume_create_manager' (84b8460c-58b4-41c8-b275-7a283d22e7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0278a856-dd65-4b12-9f9b-b9bd83c55d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0278a856-dd65-4b12-9f9b-b9bd83c55d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-904379792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9451db-142e-40ed-ac52-1f9418076fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b33922c4d64166a430573fee9ba0c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:56Z,use_quota=True,user_id='71dd795831eb48a8b4f82b5f299d3f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0484ef-1d4a-4785-bb52-ed08f5e735f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0484ef-1d4a-4785-bb52-ed08f5e735f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b578ef15-3f80-4849-80d5-a91ebfa287bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b578ef15-3f80-4849-80d5-a91ebfa287bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9451db-142e-40ed-ac52-1f9418076fc4', 'volume_name': 'volume-6d9451db-142e-40ed-ac52-1f9418076fc4', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08263dd-28c0-4552-9329-21405cfd70a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08263dd-28c0-4552-9329-21405cfd70a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da86ecab-5760-4314-b3f2-1c323117b9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:55 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Volume 6d9451db-142e-40ed-ac52-1f9418076fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9451db-142e-40ed-ac52-1f9418076fc4', 'volume_size': 1} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-904379792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9451db-142e-40ed-ac52-1f9418076fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b33922c4d64166a430573fee9ba0c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:56Z,use_quota=True,user_id='71dd795831eb48a8b4f82b5f299d3f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Creating volume 6d9451db-142e-40ed-ac52-1f9418076fc4 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:02:55 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:02:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6d9451db-142e-40ed-ac52-1f9418076fc4 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:55 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6d9451db-142e-40ed-ac52-1f9418076fc4 1073741824 Apr 29 09:02:55 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:56 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6d9451db-142e-40ed-ac52-1f9418076fc4 1073741824" returned: 0 in 1.075s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6d9451db-142e-40ed-ac52-1f9418076fc4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:56 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6d9451db-142e-40ed-ac52-1f9418076fc4 Apr 29 09:02:56 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:57 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6d9451db-142e-40ed-ac52-1f9418076fc4" returned: 0 in 0.671s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:02:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da86ecab-5760-4314-b3f2-1c323117b9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9451db-142e-40ed-ac52-1f9418076fc4', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df05333-d5a4-4b4b-bf99-a4bb97a56998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:57 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Volume volume-6d9451db-142e-40ed-ac52-1f9418076fc4 (6d9451db-142e-40ed-ac52-1f9418076fc4): created successfully Apr 29 09:02:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df05333-d5a4-4b4b-bf99-a4bb97a56998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Flow 'volume_create_manager' (84b8460c-58b4-41c8-b275-7a283d22e7b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:57 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-dace4838-4b22-4d43-a8c5-3cdc8e733d25 tempest-VolumesServicesTestJSON-1036362647 None] Created volume successfully. Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Acquiring lock "cinder-6d9451db-142e-40ed-ac52-1f9418076fc4-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Lock "cinder-6d9451db-142e-40ed-ac52-1f9418076fc4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Acquiring lock "cinder-quobyte-6d9451db-142e-40ed-ac52-1f9418076fc4" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Lock "cinder-quobyte-6d9451db-142e-40ed-ac52-1f9418076fc4" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80a6165-791a-47b4-901f-07435dcab7d2]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6d9451db-142e-40ed-ac52-1f9418076fc4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:58 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6d9451db-142e-40ed-ac52-1f9418076fc4 Apr 29 09:02:58 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Flow 'volume_create_manager' (680f14dd-e0db-4f0f-bc48-459687022ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fd86c8-f6a5-4e45-98dc-a10eb7dfb3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fd86c8-f6a5-4e45-98dc-a10eb7dfb3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2037418773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0422c452-a726-4ffd-9d4e-ef917c0d9b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e663f27d6569472ca8c96763f998e5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:59Z,use_quota=True,user_id='780043122ae7489d9c4ea935f23a14e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58c2f93-128e-4050-b397-c6bc907bc5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58c2f93-128e-4050-b397-c6bc907bc5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b8210e-f58c-4fa6-bb1c-076a3bef9fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:58 devstack cinder-volume[83712]: DEBUG cinder.image.glance [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Creating Keystone auth plugin from conf {{(pid=83712) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b8210e-f58c-4fa6-bb1c-076a3bef9fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0422c452-a726-4ffd-9d4e-ef917c0d9b9e', 'volume_name': 'volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e', 'volume_size': 1, 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '858a6a572bfe4bfbb235aa79c8ac3e8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'created_at': datetime.datetime(2026, 4, 29, 6, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:59 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d692e8ad-d391-45d5-8f32-4acf0b31ff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d692e8ad-d391-45d5-8f32-4acf0b31ff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec9fad8-fd1b-4155-8fc1-fc32502de939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:02:59 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Volume 0422c452-a726-4ffd-9d4e-ef917c0d9b9e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e', 'volume_size': 1, 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '858a6a572bfe4bfbb235aa79c8ac3e8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'created_at': datetime.datetime(2026, 4, 29, 6, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Trying to clone 0422c452-a726-4ffd-9d4e-ef917c0d9b9e from image 34fc92fe-7bdb-4c18-872f-7ff972aac86b at location (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]). {{(pid=83712) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6d9451db-142e-40ed-ac52-1f9418076fc4" returned: 0 in 0.885s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6d9451db-142e-40ed-ac52-1f9418076fc4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:59 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6d9451db-142e-40ed-ac52-1f9418076fc4 Apr 29 09:02:59 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83712) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 09:02:59 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Image download 20.69 MB at 20.69 MB/s Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:59 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:02:59 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf77872-3c39-4153-87c6-2494f9ebd491]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:59 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD Apr 29 09:02:59 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:59 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6d9451db-142e-40ed-ac52-1f9418076fc4" returned: 0 in 0.922s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Lock "cinder-quobyte-6d9451db-142e-40ed-ac52-1f9418076fc4" released by "delete_volume" :: held 1.872s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Created reservations ['bafabd1d-187b-4a29-8770-afff5fc670fa', '31491f6b-5e31-4cb1-a1f5-3bc81eba7328', '28baf264-29ba-4f05-9a6f-411c7232902a', '820953cd-f982-4f28-a250-2ed1a837a6b1'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:00 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:03:00 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:00 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD" returned: 0 in 0.944s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Temporary image 34fc92fe-7bdb-4c18-872f-7ff972aac86b is fetched for user 780043122ae7489d9c4ea935f23a14e1. {{(pid=83712) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 09:03:00 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.022s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[7264976e-85ba-44fd-9984-c14b183567b8]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:00 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD Apr 29 09:03:00 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:01 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.918s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:03:01 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Deleted volume successfully. Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8d9755e1-b597-49d3-9cc7-012ad352d3b6 tempest-VolumesServicesTestJSON-1036362647 None] Lock "cinder-6d9451db-142e-40ed-ac52-1f9418076fc4-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:01 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD" returned: 0 in 0.889s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2037418773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0422c452-a726-4ffd-9d4e-ef917c0d9b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e663f27d6569472ca8c96763f998e5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:02:59Z,use_quota=True,user_id='780043122ae7489d9c4ea935f23a14e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Creating volume 0422c452-a726-4ffd-9d4e-ef917c0d9b9e {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:03:01 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:03:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:01 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e 1073741824 Apr 29 09:03:01 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:02 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e 1073741824" returned: 0 in 0.999s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:02 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e Apr 29 09:03:02 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:03 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e" returned: 0 in 0.636s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:03:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:03 devstack cinder-volume[83712]: DEBUG cinder.volume.volume_utils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Attempting download of 34fc92fe-7bdb-4c18-872f-7ff972aac86b ((None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}])) to volume 0422c452-a726-4ffd-9d4e-ef917c0d9b9e. {{(pid=83712) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 09:03:03 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[4206c4d8-2605-4d1e-9091-ef02d885bfc6]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_nzvdcpvq {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:03 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_nzvdcpvq Apr 29 09:03:03 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:04 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_nzvdcpvq" returned: 0 in 1.049s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_nzvdcpvq {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:04 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_nzvdcpvq Apr 29 09:03:04 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:05 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_nzvdcpvq" returned: 1 in 0.896s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_nzvdcpvq' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5fa8ba-e6af-4147-878d-26ee12495ec9]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:05 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD Apr 29 09:03:05 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Flow 'volume_create_manager' (c23623e5-9385-478c-84e0-0282cb2e49fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f00db8f-a032-4923-9011-52eaa6cf7636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f00db8f-a032-4923-9011-52eaa6cf7636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2124383171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e26a7b-283f-411c-a465-ff2bf65b7a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e97245e5da3423d91ec4a196e284296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:05Z,use_quota=True,user_id='e07267d346f64c3b87d1b17dd2b04d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb76d0fa-07a6-41dd-937d-f2476f3863eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb76d0fa-07a6-41dd-937d-f2476f3863eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ffd7c9-a6c7-4c0a-8fba-b7ff29c4f037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ffd7c9-a6c7-4c0a-8fba-b7ff29c4f037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e26a7b-283f-411c-a465-ff2bf65b7a4a', 'volume_name': 'volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a13891-1048-46d2-adaa-0d068c3731fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a13891-1048-46d2-adaa-0d068c3731fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9488ff-d653-4e94-acb8-dbe102333efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:05 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Volume 79e26a7b-283f-411c-a465-ff2bf65b7a4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a', 'volume_size': 1} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2124383171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e26a7b-283f-411c-a465-ff2bf65b7a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e97245e5da3423d91ec4a196e284296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:05Z,use_quota=True,user_id='e07267d346f64c3b87d1b17dd2b04d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Creating volume 79e26a7b-283f-411c-a465-ff2bf65b7a4a {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:03:05 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:03:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:05 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a 1073741824 Apr 29 09:03:05 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:06 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD" returned: 0 in 0.839s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:06 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] 34fc92fe-7bdb-4c18-872f-7ff972aac86b was qcow2, converting to raw {{(pid=83712) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 09:03:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:06 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e Apr 29 09:03:06 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:06 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a 1073741824" returned: 0 in 0.917s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:06 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a Apr 29 09:03:06 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:07 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a" returned: 0 in 0.792s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9488ff-d653-4e94-acb8-dbe102333efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441ebc05-1362-47b6-9dd0-970141113652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:07 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Volume volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a (79e26a7b-283f-411c-a465-ff2bf65b7a4a): created successfully Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441ebc05-1362-47b6-9dd0-970141113652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Flow 'volume_create_manager' (c23623e5-9385-478c-84e0-0282cb2e49fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Flow 'volume_create_manager' (e84eda62-0143-4bf7-b9a1-2ddc6ece9388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9873b941-2577-4cb1-a4b4-0b896c49e835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9873b941-2577-4cb1-a4b4-0b896c49e835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-911316065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5136f7d1-9a6a-4b68-bf38-10b00589216a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d568a0868a4bddb592ead99fb0cc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:07Z,use_quota=True,user_id='e634ebc560964803a94a068e7bbc9771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e25197-fe9a-4d8f-b091-a263aea7a246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e25197-fe9a-4d8f-b091-a263aea7a246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7c7c3d-663d-4e87-8c8c-5a6d45d09111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7c7c3d-663d-4e87-8c8c-5a6d45d09111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5136f7d1-9a6a-4b68-bf38-10b00589216a', 'volume_name': 'volume-5136f7d1-9a6a-4b68-bf38-10b00589216a', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77edb9e7-af2f-4683-9791-902203f52b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77edb9e7-af2f-4683-9791-902203f52b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93514d2-c38d-43d0-ade3-9a97e86729f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:07 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Volume 5136f7d1-9a6a-4b68-bf38-10b00589216a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5136f7d1-9a6a-4b68-bf38-10b00589216a', 'volume_size': 1} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-911316065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5136f7d1-9a6a-4b68-bf38-10b00589216a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d568a0868a4bddb592ead99fb0cc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:07Z,use_quota=True,user_id='e634ebc560964803a94a068e7bbc9771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Creating volume 5136f7d1-9a6a-4b68-bf38-10b00589216a {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:03:07 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:03:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:07 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d68cb88a-b315-4ac6-8156-acab415c767a tempest-VolumesActionsTest-874268659 None] Created volume successfully. Apr 29 09:03:07 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a 1073741824 Apr 29 09:03:07 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:08 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e" returned: 0 in 2.189s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:08 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_l07pb888devstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:03:08 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Converted 112.00 MB image at 51.14 MB/s Apr 29 09:03:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:08 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e 1G Apr 29 09:03:08 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:08 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a 1073741824" returned: 0 in 0.928s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:08 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a Apr 29 09:03:08 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:09 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e 1G" returned: 0 in 0.760s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6d4a76-f3a4-4fd9-ba98-13397f923b19]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:09 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a" returned: 0 in 0.635s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93514d2-c38d-43d0-ade3-9a97e86729f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5136f7d1-9a6a-4b68-bf38-10b00589216a', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b20881b-c80f-4fbb-b621-753e7e519773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:09 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Volume volume-5136f7d1-9a6a-4b68-bf38-10b00589216a (5136f7d1-9a6a-4b68-bf38-10b00589216a): created successfully Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b20881b-c80f-4fbb-b621-753e7e519773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Flow 'volume_create_manager' (e84eda62-0143-4bf7-b9a1-2ddc6ece9388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:09 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-14821039-597a-410b-bec5-94fe3f4a8119 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Created volume successfully. Apr 29 09:03:09 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e Apr 29 09:03:09 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Creating offline snapshot 32377d77-8cb8-4848-b861-968e878ea15f of volume 5136f7d1-9a6a-4b68-bf38-10b00589216a {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe385c1-0f3b-4a77-bdfd-7cd10d3faf4a]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:09 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a Apr 29 09:03:09 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:10 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e" returned: 0 in 0.870s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:10 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e Apr 29 09:03:10 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:10 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a" returned: 0 in 0.763s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:10 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f 1G Apr 29 09:03:10 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:10 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e" returned: 1 in 0.759s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG cinder.volume.volume_utils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Downloaded image 34fc92fe-7bdb-4c18-872f-7ff972aac86b ((None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}])) to volume 0422c452-a726-4ffd-9d4e-ef917c0d9b9e successfully. {{(pid=83712) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Temporary image 34fc92fe-7bdb-4c18-872f-7ff972aac86b for user 780043122ae7489d9c4ea935f23a14e1 is deleted. {{(pid=83712) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG cinder.volume.volume_utils [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Marking volume 0422c452-a726-4ffd-9d4e-ef917c0d9b9e as bootable. {{(pid=83712) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Copying metadata from image 34fc92fe-7bdb-4c18-872f-7ff972aac86b to 0422c452-a726-4ffd-9d4e-ef917c0d9b9e. {{(pid=83712) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Creating volume glance metadata for volume 0422c452-a726-4ffd-9d4e-ef917c0d9b9e backed by image 34fc92fe-7bdb-4c18-872f-7ff972aac86b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83712) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec9fad8-fd1b-4155-8fc1-fc32502de939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e', 'volume_size': 1, 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '858a6a572bfe4bfbb235aa79c8ac3e8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'created_at': datetime.datetime(2026, 4, 29, 6, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b406697-287d-40f3-852a-88eebc9da751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:10 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Volume volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e (0422c452-a726-4ffd-9d4e-ef917c0d9b9e): created successfully Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b406697-287d-40f3-852a-88eebc9da751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Flow 'volume_create_manager' (680f14dd-e0db-4f0f-bc48-459687022ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:10 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-9db36adc-9c6a-45c9-9204-90b2859beb8f tempest-VolumesExtendTest-2096093973 None] Created volume successfully. Apr 29 09:03:11 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f 1G" returned: 0 in 0.793s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5136f7d1-9a6a-4b68-bf38-10b00589216a -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:11 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5136f7d1-9a6a-4b68-bf38-10b00589216a -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f Apr 29 09:03:11 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f3278ecd-7ace-4d63-96f2-1e190f23a83d tempest-VolumesExtendTest-2096093973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:12 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5136f7d1-9a6a-4b68-bf38-10b00589216a -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f" returned: 0 in 0.654s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:12 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f is being set with open permissions: ugo+rw Apr 29 09:03:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:12 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f Apr 29 09:03:12 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:12 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f" returned: 0 in 0.578s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:12 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.info Apr 29 09:03:12 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:13 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.info" returned: 0 in 0.582s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:13 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.info is being set with open permissions: ugo+rw Apr 29 09:03:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:13 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.info Apr 29 09:03:13 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:13 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.info" returned: 0 in 0.635s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.093s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f3278ecd-7ace-4d63-96f2-1e190f23a83d tempest-VolumesExtendTest-2096093973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.970s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:13 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f73b07c9-e4e6-4ce4-acaa-53efbfeb9cca tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Create snapshot completed successfully Apr 29 09:03:13 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb89bf7a-fea3-45e0-8934-d3ff3fabbd76]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3278ecd-7ace-4d63-96f2-1e190f23a83d tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:14 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e Apr 29 09:03:14 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:14 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3278ecd-7ace-4d63-96f2-1e190f23a83d tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e" returned: 0 in 0.761s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3278ecd-7ace-4d63-96f2-1e190f23a83d tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:14 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e Apr 29 09:03:14 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:15 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3278ecd-7ace-4d63-96f2-1e190f23a83d tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e" returned: 1 in 0.784s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3278ecd-7ace-4d63-96f2-1e190f23a83d tempest-VolumesExtendTest-2096093973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3278ecd-7ace-4d63-96f2-1e190f23a83d tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e 2G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Acquiring lock "cinder-32377d77-8cb8-4848-b861-968e878ea15f-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "cinder-32377d77-8cb8-4848-b861-968e878ea15f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Acquiring lock "cinder-quobyte-5136f7d1-9a6a-4b68-bf38-10b00589216a" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "cinder-quobyte-5136f7d1-9a6a-4b68-bf38-10b00589216a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Acquiring lock "cinder-quobyte-32377d77-8cb8-4848-b861-968e878ea15f" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "cinder-quobyte-32377d77-8cb8-4848-b861-968e878ea15f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Deleting offline snapshot 32377d77-8cb8-4848-b861-968e878ea15f of volume 5136f7d1-9a6a-4b68-bf38-10b00589216a {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] snapshot_file for this snap is: volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3278ecd-7ace-4d63-96f2-1e190f23a83d tempest-VolumesExtendTest-2096093973 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e 2G" returned: 0 in 0.120s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f3278ecd-7ace-4d63-96f2-1e190f23a83d tempest-VolumesExtendTest-2096093973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.726s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[36be9ba2-ba3d-46f4-9df0-f6f448480259]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:15 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f3278ecd-7ace-4d63-96f2-1e190f23a83d tempest-VolumesExtendTest-2096093973 None] Extend volume completed successfully. Apr 29 09:03:15 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f Apr 29 09:03:15 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:16 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f" returned: 0 in 0.759s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:16 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5136f7d1-9a6a-4b68-bf38-10b00589216a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:03:16 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[09acb703-5872-4577-b3e6-47acc891bc63]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Acquiring lock "cinder-0422c452-a726-4ffd-9d4e-ef917c0d9b9e-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Lock "cinder-0422c452-a726-4ffd-9d4e-ef917c0d9b9e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Acquiring lock "cinder-quobyte-0422c452-a726-4ffd-9d4e-ef917c0d9b9e" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:16 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a Apr 29 09:03:16 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Lock "cinder-quobyte-0422c452-a726-4ffd-9d4e-ef917c0d9b9e" acquired by "delete_volume" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:16 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b45727c-854b-474d-b591-54e818fe9746]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:16 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e Apr 29 09:03:16 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:17 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a" returned: 0 in 0.748s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:17 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f Apr 29 09:03:17 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:17 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e" returned: 0 in 0.708s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:17 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e Apr 29 09:03:17 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:17 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f" returned: 0 in 0.719s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:17 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f Apr 29 09:03:17 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:18 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e" returned: 1 in 0.789s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:18 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e Apr 29 09:03:18 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:18 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a.32377d77-8cb8-4848-b861-968e878ea15f" returned: 0 in 0.669s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "cinder-quobyte-32377d77-8cb8-4848-b861-968e878ea15f" released by "_delete_snapshot" :: held 3.017s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "cinder-quobyte-5136f7d1-9a6a-4b68-bf38-10b00589216a" released by "delete_snapshot" :: held 3.044s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Created reservations ['88592e5c-0ac0-4c73-abde-7f8e647f0447', '09d655a3-e14a-4fde-8ff3-9e391f800cf5', '7c60dbcc-f19d-4d97-a0b5-331021d936a8', '9bb4f6b2-2b4b-4962-8c55-edcbfcc69906'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:03:18 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Delete snapshot completed successfully. Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a2ca4b9-6594-4869-bf0d-e57c54d2f078 tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "cinder-32377d77-8cb8-4848-b861-968e878ea15f-delete_snapshot" released by "delete_snapshot" :: held 3.201s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:18 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-0422c452-a726-4ffd-9d4e-ef917c0d9b9e" returned: 0 in 0.650s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Lock "cinder-quobyte-0422c452-a726-4ffd-9d4e-ef917c0d9b9e" released by "delete_volume" :: held 2.230s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Created reservations ['c6f83513-d6e9-4469-972c-904bcb66ac39', '26b663ff-505a-42b8-bcc0-9baa243abdd4', '3124db97-cc50-4768-9489-132fde00bc64', '2a926ff9-de4a-4f28-88cb-ceda3d8ed926'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:18 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:03:18 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:19 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.604s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:19 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:03:19 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Deleted volume successfully. Apr 29 09:03:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8ac26a5d-9341-4b0d-8c68-befc8c36fb1b tempest-VolumesExtendTest-2096093973 None] Lock "cinder-0422c452-a726-4ffd-9d4e-ef917c0d9b9e-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Acquiring lock "cinder-5136f7d1-9a6a-4b68-bf38-10b00589216a-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "cinder-5136f7d1-9a6a-4b68-bf38-10b00589216a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Acquiring lock "cinder-quobyte-5136f7d1-9a6a-4b68-bf38-10b00589216a" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "cinder-quobyte-5136f7d1-9a6a-4b68-bf38-10b00589216a" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:19 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[79866265-d5c7-4063-8229-49142d3948f9]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:20 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a Apr 29 09:03:20 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Flow 'volume_create_manager' (36cc45ca-82cd-4eda-bd4b-469b689e2691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eadaddb-42e9-45fa-b069-ede44bfcc595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eadaddb-42e9-45fa-b069-ede44bfcc595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1456205166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09b1d1f-6afa-4192-821b-8ea8e31ff67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e663f27d6569472ca8c96763f998e5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:20Z,use_quota=True,user_id='780043122ae7489d9c4ea935f23a14e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49dc781-52f9-41af-a27a-befb92630f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49dc781-52f9-41af-a27a-befb92630f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba74e7a0-079a-46a7-8226-c392e2136f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba74e7a0-079a-46a7-8226-c392e2136f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b09b1d1f-6afa-4192-821b-8ea8e31ff67e', 'volume_name': 'volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0831bd-0f82-4249-891d-7f284df00876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0831bd-0f82-4249-891d-7f284df00876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d57984-2007-4e98-a274-2961eee62226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:20 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Volume b09b1d1f-6afa-4192-821b-8ea8e31ff67e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e', 'volume_size': 1} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1456205166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09b1d1f-6afa-4192-821b-8ea8e31ff67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e663f27d6569472ca8c96763f998e5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:20Z,use_quota=True,user_id='780043122ae7489d9c4ea935f23a14e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Creating volume b09b1d1f-6afa-4192-821b-8ea8e31ff67e {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:03:20 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:03:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:20 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e 1073741824 Apr 29 09:03:20 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:21 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a" returned: 0 in 1.439s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:21 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a Apr 29 09:03:21 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:21 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e 1073741824" returned: 0 in 1.257s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:21 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e Apr 29 09:03:21 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:22 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-5136f7d1-9a6a-4b68-bf38-10b00589216a" returned: 0 in 0.710s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "cinder-quobyte-5136f7d1-9a6a-4b68-bf38-10b00589216a" released by "delete_volume" :: held 2.234s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Created reservations ['bf00ac90-abce-4adc-9929-fa937ee1dc11', '38d6b8c3-942f-4db8-831f-cda058e83671', 'dfa7721e-3031-4937-befc-37e69fba779a', 'c6cf0dd9-2a0d-4f5a-b6e5-4b7f8400d988'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:22 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:03:22 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:22 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e" returned: 0 in 0.841s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d57984-2007-4e98-a274-2961eee62226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea84f6b1-fe0e-48db-880d-afd667769330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:22 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Volume volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e (b09b1d1f-6afa-4192-821b-8ea8e31ff67e): created successfully Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea84f6b1-fe0e-48db-880d-afd667769330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Flow 'volume_create_manager' (36cc45ca-82cd-4eda-bd4b-469b689e2691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:22 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-5a3f3939-72eb-4e45-b866-5bc23db600e8 tempest-VolumesExtendTest-2096093973 None] Created volume successfully. Apr 29 09:03:23 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.673s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:23 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:03:23 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Deleted volume successfully. Apr 29 09:03:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-12bacda2-fba9-4f3c-ab2c-18906332193a tempest-VolumeSnapshotQuotasNegativeTestJSON-300382798 None] Lock "cinder-5136f7d1-9a6a-4b68-bf38-10b00589216a-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] Creating offline snapshot 9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 of volume b09b1d1f-6afa-4192-821b-8ea8e31ff67e {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:03:23 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[227d1278-e501-464a-be89-ab71bd56ebf2]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:23 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e Apr 29 09:03:23 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7d9f2970-8823-4c6a-9c7e-eac5df3db523 tempest-VolumesActionsTest-874268659 None] Acquiring lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a" by "attach_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7d9f2970-8823-4c6a-9c7e-eac5df3db523 tempest-VolumesActionsTest-874268659 None] Lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a" acquired by "attach_volume" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:24 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-7d9f2970-8823-4c6a-9c7e-eac5df3db523 tempest-VolumesActionsTest-874268659 None] Attaching volume 79e26a7b-283f-411c-a465-ff2bf65b7a4a to instance 79e05b19-0b89-4f2d-89f6-e075aa10e120 at mountpoint /dev/vdb on host None. Apr 29 09:03:24 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-7d9f2970-8823-4c6a-9c7e-eac5df3db523 tempest-VolumesActionsTest-874268659 None] Attach volume completed successfully. Apr 29 09:03:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7d9f2970-8823-4c6a-9c7e-eac5df3db523 tempest-VolumesActionsTest-874268659 None] Lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a" released by "attach_volume" :: held 0.137s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-257ff2ac-9526-4b1e-957e-f7be5f68ea44 tempest-VolumesActionsTest-874268659 None] Acquiring lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a-detach_volume" by "detach_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-257ff2ac-9526-4b1e-957e-f7be5f68ea44 tempest-VolumesActionsTest-874268659 None] Lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:24 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-257ff2ac-9526-4b1e-957e-f7be5f68ea44 tempest-VolumesActionsTest-874268659 None] Detaching volume 79e26a7b-283f-411c-a465-ff2bf65b7a4a from instance 79e05b19-0b89-4f2d-89f6-e075aa10e120. Apr 29 09:03:24 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e" returned: 0 in 0.956s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:24 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-257ff2ac-9526-4b1e-957e-f7be5f68ea44 tempest-VolumesActionsTest-874268659 None] Detach volume completed successfully. Apr 29 09:03:24 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 1G Apr 29 09:03:24 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-257ff2ac-9526-4b1e-957e-f7be5f68ea44 tempest-VolumesActionsTest-874268659 None] Lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:25 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 1G" returned: 0 in 1.080s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:25 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 Apr 29 09:03:25 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:26 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6" returned: 0 in 0.877s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:26 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 is being set with open permissions: ugo+rw Apr 29 09:03:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:26 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 Apr 29 09:03:26 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:27 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6" returned: 0 in 0.759s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:27 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.info Apr 29 09:03:27 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:28 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.info" returned: 0 in 0.670s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:28 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.info is being set with open permissions: ugo+rw Apr 29 09:03:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:28 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.info Apr 29 09:03:28 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:28 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.info" returned: 0 in 0.715s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.166s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:28 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-284bc2a6-b53d-45a7-a9e2-6cd7a3847cf5 tempest-VolumesExtendTest-2096093973 None] Create snapshot completed successfully Apr 29 09:03:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9e796bf4-fa23-48b9-89b5-cc7f859a352a tempest-VolumesExtendTest-2096093973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9e796bf4-fa23-48b9-89b5-cc7f859a352a tempest-VolumesExtendTest-2096093973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:30 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce8a5ac-2566-4d2c-837f-ff3bf7f49661]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9e796bf4-fa23-48b9-89b5-cc7f859a352a tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:30 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e Apr 29 09:03:30 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:31 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9e796bf4-fa23-48b9-89b5-cc7f859a352a tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e" returned: 0 in 0.864s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9e796bf4-fa23-48b9-89b5-cc7f859a352a tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 2G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9e796bf4-fa23-48b9-89b5-cc7f859a352a tempest-VolumesExtendTest-2096093973 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 2G" returned: 0 in 0.179s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9e796bf4-fa23-48b9-89b5-cc7f859a352a tempest-VolumesExtendTest-2096093973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.100s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:31 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-9e796bf4-fa23-48b9-89b5-cc7f859a352a tempest-VolumesExtendTest-2096093973 None] Extend volume completed successfully. Apr 29 09:03:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Acquiring lock "cinder-9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Lock "cinder-9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Acquiring lock "cinder-quobyte-b09b1d1f-6afa-4192-821b-8ea8e31ff67e" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Lock "cinder-quobyte-b09b1d1f-6afa-4192-821b-8ea8e31ff67e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Acquiring lock "cinder-quobyte-9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Lock "cinder-quobyte-9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:32 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Deleting offline snapshot 9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 of volume b09b1d1f-6afa-4192-821b-8ea8e31ff67e {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:03:32 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] snapshot_file for this snap is: volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:03:32 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[906110fb-1651-4e76-b5fc-7227d40472b5]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:32 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 Apr 29 09:03:32 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:33 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6" returned: 0 in 0.857s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:03:33 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[c533e393-b43f-4a7e-9549-338aa926d749]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:33 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e Apr 29 09:03:33 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:34 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e" returned: 0 in 0.773s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:34 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 Apr 29 09:03:34 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:35 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6" returned: 0 in 0.863s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:35 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6 Apr 29 09:03:35 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:35 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e.9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6" returned: 0 in 0.634s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Lock "cinder-quobyte-9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6" released by "_delete_snapshot" :: held 3.264s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Lock "cinder-quobyte-b09b1d1f-6afa-4192-821b-8ea8e31ff67e" released by "delete_snapshot" :: held 3.299s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:35 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Created reservations ['336e8f4c-2e93-4201-afa9-704008b557e6', 'ffa0bcf4-27ca-4c71-b6aa-9431dc7e9044', 'a656a946-fbab-4dd3-a286-4afa9584af08', '5486c87b-b5b6-41b9-b055-9aebf5201b19'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:03:36 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Delete snapshot completed successfully. Apr 29 09:03:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-faeadc54-8938-4309-b4f8-704565c50547 tempest-VolumesExtendTest-2096093973 None] Lock "cinder-9f2b1ab8-b2f8-41fa-b30a-60f57a3a35b6-delete_snapshot" released by "delete_snapshot" :: held 3.448s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Acquiring lock "cinder-b09b1d1f-6afa-4192-821b-8ea8e31ff67e-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Lock "cinder-b09b1d1f-6afa-4192-821b-8ea8e31ff67e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Acquiring lock "cinder-quobyte-b09b1d1f-6afa-4192-821b-8ea8e31ff67e" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Lock "cinder-quobyte-b09b1d1f-6afa-4192-821b-8ea8e31ff67e" acquired by "delete_volume" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:37 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8d8e83-eeba-403b-9d60-a4e222499bd2]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:37 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e Apr 29 09:03:37 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:37 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e" returned: 0 in 0.881s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:37 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e Apr 29 09:03:37 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:38 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b09b1d1f-6afa-4192-821b-8ea8e31ff67e" returned: 0 in 0.790s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Lock "cinder-quobyte-b09b1d1f-6afa-4192-821b-8ea8e31ff67e" released by "delete_volume" :: held 1.758s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:38 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Created reservations ['d14bbc9b-e42d-49d3-8d25-3ad5a2c90767', '1a196d2f-e258-4cd9-af5c-5b82c06958cf', 'f93c0375-f39d-4759-a7bc-d71f6016f914', '154bc079-58dd-4ea0-81e9-23a723385bb3'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:03:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:38 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:38 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:38 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:03:38 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:39 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.787s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:03:39 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Deleted volume successfully. Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Flow 'volume_create_manager' (9b6a5d1d-de91-4eef-a5bc-b260146fecaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a525cfa6-b9fa-42ff-aa11-29215b3a3e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-641393ed-401d-40c3-88fb-556669b961f6 tempest-VolumesExtendTest-2096093973 None] Lock "cinder-b09b1d1f-6afa-4192-821b-8ea8e31ff67e-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:UPDATE=124,cinder:DELETE=10,cinder:SELECT=101,cinder:INSERT=35 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a525cfa6-b9fa-42ff-aa11-29215b3a3e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2142170711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca4b1a6-5f63-4ac0-9213-7838931abdb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0359561a78824517b21ec82f78036a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:40Z,use_quota=True,user_id='f7f0a9164cf940baabf978586181aa0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a6f5e1-fe01-44cb-9776-61ae4b57d13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a6f5e1-fe01-44cb-9776-61ae4b57d13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d23d3a0-dc3a-471a-87ca-d63ae84fb767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d23d3a0-dc3a-471a-87ca-d63ae84fb767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca4b1a6-5f63-4ac0-9213-7838931abdb2', 'volume_name': 'volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef35b10-c6fe-4722-84f3-9de23aa4f254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef35b10-c6fe-4722-84f3-9de23aa4f254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97597a49-bfcf-4ca6-b1d3-d09ca2eca99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:39 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Volume 8ca4b1a6-5f63-4ac0-9213-7838931abdb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2', 'volume_size': 1} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2142170711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca4b1a6-5f63-4ac0-9213-7838931abdb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0359561a78824517b21ec82f78036a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:40Z,use_quota=True,user_id='f7f0a9164cf940baabf978586181aa0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Creating volume 8ca4b1a6-5f63-4ac0-9213-7838931abdb2 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:03:39 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:03:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:39 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2 1073741824 Apr 29 09:03:39 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:40 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2 1073741824" returned: 0 in 0.903s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:40 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=118,cinder:UPDATE=137,cinder:INSERT=38,cinder:DELETE=10 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:03:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:40 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2 Apr 29 09:03:40 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:41 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2" returned: 0 in 0.631s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:03:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97597a49-bfcf-4ca6-b1d3-d09ca2eca99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6611239-6e2c-48fc-9fc7-c069fb29bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:41 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Volume volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2 (8ca4b1a6-5f63-4ac0-9213-7838931abdb2): created successfully Apr 29 09:03:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6611239-6e2c-48fc-9fc7-c069fb29bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:41 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Flow 'volume_create_manager' (9b6a5d1d-de91-4eef-a5bc-b260146fecaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:41 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c417a322-74e4-4d6b-8aec-eeaa047433e7 tempest-VolumesMetadataTest-1184967626 None] Created volume successfully. Apr 29 09:03:42 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Acquiring lock "cinder-8ca4b1a6-5f63-4ac0-9213-7838931abdb2-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:42 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Lock "cinder-8ca4b1a6-5f63-4ac0-9213-7838931abdb2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:42 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Acquiring lock "cinder-quobyte-8ca4b1a6-5f63-4ac0-9213-7838931abdb2" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:42 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Lock "cinder-quobyte-8ca4b1a6-5f63-4ac0-9213-7838931abdb2" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:42 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a4ae61-51e7-468e-9eb6-8e21abf675aa]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:42 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2 Apr 29 09:03:42 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:43 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2" returned: 0 in 0.847s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:43 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2 Apr 29 09:03:43 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:44 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8ca4b1a6-5f63-4ac0-9213-7838931abdb2" returned: 0 in 0.672s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Lock "cinder-quobyte-8ca4b1a6-5f63-4ac0-9213-7838931abdb2" released by "delete_volume" :: held 1.568s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:44 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Created reservations ['b4c61630-6339-4ba8-be2e-ee3e28635e9a', 'c9c76b8d-d262-437d-bc18-5ef23ad4bcd4', 'c8556a69-630c-42aa-a6bf-cae106a910c2', 'e5f6e63d-3f82-4daf-a83b-073c5feaf4d3'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:03:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:44 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:03:44 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:44 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.627s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:44 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:03:44 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Deleted volume successfully. Apr 29 09:03:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-142604ce-a0ba-4513-bd7b-9d27f8774ebd tempest-VolumesMetadataTest-1184967626 None] Lock "cinder-8ca4b1a6-5f63-4ac0-9213-7838931abdb2-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-23f200fd-3203-40bf-9b0e-7c0fbaf083a7 tempest-VolumesActionsTest-874268659 None] Acquiring lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a" by "attach_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-23f200fd-3203-40bf-9b0e-7c0fbaf083a7 tempest-VolumesActionsTest-874268659 None] Lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a" acquired by "attach_volume" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:48 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-23f200fd-3203-40bf-9b0e-7c0fbaf083a7 tempest-VolumesActionsTest-874268659 None] Attaching volume 79e26a7b-283f-411c-a465-ff2bf65b7a4a to instance c68ad2c1-d595-4cde-a2f8-063ccf08da87 at mountpoint /dev/vdb on host None. Apr 29 09:03:48 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-23f200fd-3203-40bf-9b0e-7c0fbaf083a7 tempest-VolumesActionsTest-874268659 None] Attach volume completed successfully. Apr 29 09:03:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-23f200fd-3203-40bf-9b0e-7c0fbaf083a7 tempest-VolumesActionsTest-874268659 None] Lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a" released by "attach_volume" :: held 0.242s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2d39e2d8-2652-41eb-aa2e-807cd2c03cd8 tempest-VolumesActionsTest-874268659 None] Acquiring lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a-detach_volume" by "detach_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2d39e2d8-2652-41eb-aa2e-807cd2c03cd8 tempest-VolumesActionsTest-874268659 None] Lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:49 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-2d39e2d8-2652-41eb-aa2e-807cd2c03cd8 tempest-VolumesActionsTest-874268659 None] Detaching volume 79e26a7b-283f-411c-a465-ff2bf65b7a4a from instance c68ad2c1-d595-4cde-a2f8-063ccf08da87. Apr 29 09:03:49 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-2d39e2d8-2652-41eb-aa2e-807cd2c03cd8 tempest-VolumesActionsTest-874268659 None] Detach volume completed successfully. Apr 29 09:03:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2d39e2d8-2652-41eb-aa2e-807cd2c03cd8 tempest-VolumesActionsTest-874268659 None] Lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:50 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:03:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Flow 'volume_create_manager' (6f363e8c-7203-4ab9-926a-c3dbfc0e525e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6ad683-ae72-4b77-8937-beb9808953a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6ad683-ae72-4b77-8937-beb9808953a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-624611752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8b3aa0-d701-47c1-a0fa-cba9048d9b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7da470b07b04649bee9f3346ef00303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:51Z,use_quota=True,user_id='07676288a1d944898e6c98c063a3ecf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111d190b-3690-42b6-ac7f-acabf391158f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111d190b-3690-42b6-ac7f-acabf391158f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7bca1e-b339-4b10-b6b1-000325e8934f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7bca1e-b339-4b10-b6b1-000325e8934f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c8b3aa0-d701-47c1-a0fa-cba9048d9b51', 'volume_name': 'volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f228c32b-b8eb-4700-b0e6-c57357f7c4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f228c32b-b8eb-4700-b0e6-c57357f7c4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dc722f-7a14-4e9e-ae29-263141102339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:51 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Volume 8c8b3aa0-d701-47c1-a0fa-cba9048d9b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51', 'volume_size': 1} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-624611752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8b3aa0-d701-47c1-a0fa-cba9048d9b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7da470b07b04649bee9f3346ef00303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:51Z,use_quota=True,user_id='07676288a1d944898e6c98c063a3ecf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Creating volume 8c8b3aa0-d701-47c1-a0fa-cba9048d9b51 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:03:51 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:03:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:51 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51 1073741824 Apr 29 09:03:51 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:52 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51 1073741824" returned: 0 in 1.003s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:52 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51 Apr 29 09:03:52 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:52 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51" returned: 0 in 0.591s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:03:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dc722f-7a14-4e9e-ae29-263141102339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacca008-acdf-41ea-8fba-168016a1e8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:52 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Volume volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51 (8c8b3aa0-d701-47c1-a0fa-cba9048d9b51): created successfully Apr 29 09:03:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacca008-acdf-41ea-8fba-168016a1e8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Flow 'volume_create_manager' (6f363e8c-7203-4ab9-926a-c3dbfc0e525e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:52 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-42425dc6-36bd-4d67-b408-f3b6350cef21 tempest-VolumesTransfersTest-951979768 None] Created volume successfully. Apr 29 09:03:53 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d2812b11-081f-489a-9e50-5b30bcf903d9 tempest-VolumesTransfersTest-79012323 None] Transfer volume completed successfully. Apr 29 09:03:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Acquiring lock "cinder-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Lock "cinder-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Acquiring lock "cinder-quobyte-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:03:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Lock "cinder-quobyte-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51" acquired by "delete_volume" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:03:54 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d6aa41-b14d-4bef-937d-2fb6f5a578c7]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:55 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51 Apr 29 09:03:55 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:55 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51" returned: 0 in 0.812s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:55 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51 Apr 29 09:03:55 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Flow 'volume_create_manager' (65f29c51-231a-4c8e-8c5b-dfc978e89ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5150d4a3-0a1d-4d65-b7bf-9b486e8f7e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5150d4a3-0a1d-4d65-b7bf-9b486e8f7e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1793467501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d583fc-5c36-471f-aade-fcd89f1fb80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e22b58be31b4643ad84f7a39e81d66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:56Z,use_quota=True,user_id='2344d611a1cf4f99b62401465074ccac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cd86ca-ae5d-4a3f-9c9f-1e11d6cda150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cd86ca-ae5d-4a3f-9c9f-1e11d6cda150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf88b668-eabc-4fb7-95b8-b545fbc8cb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf88b668-eabc-4fb7-95b8-b545fbc8cb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0d583fc-5c36-471f-aade-fcd89f1fb80d', 'volume_name': 'volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff9ef70-56c8-4044-a35a-a5dad76e729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff9ef70-56c8-4044-a35a-a5dad76e729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2bc212a-e241-4038-a592-f5ada4d8c3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:55 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Volume e0d583fc-5c36-471f-aade-fcd89f1fb80d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d', 'volume_size': 1} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1793467501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d583fc-5c36-471f-aade-fcd89f1fb80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e22b58be31b4643ad84f7a39e81d66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:56Z,use_quota=True,user_id='2344d611a1cf4f99b62401465074ccac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Creating volume e0d583fc-5c36-471f-aade-fcd89f1fb80d {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:03:55 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:03:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:55 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d 1073741824 Apr 29 09:03:55 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:56 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51" returned: 0 in 0.731s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:56 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Lock "cinder-quobyte-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51" released by "delete_volume" :: held 1.606s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:56 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Created reservations ['1668b110-572d-4aa2-91bd-404720927ba8', 'fdd18be2-7c34-454c-8b2a-b62b46b1bff4', '0ff9fdf9-1e73-4e77-9923-0cc3b7843034', 'd6371f8e-3ada-4bcd-b8fc-c23e4ca39818'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:03:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:56 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:56 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:56 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:03:56 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:56 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d 1073741824" returned: 0 in 1.011s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:57 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d Apr 29 09:03:57 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:57 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.903s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:03:57 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Deleted volume successfully. Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4adb8ac6-f752-4763-9d06-d53c242c8410 tempest-VolumesTransfersTest-733685552 None] Lock "cinder-8c8b3aa0-d701-47c1-a0fa-cba9048d9b51-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Flow 'volume_create_manager' (cf6eac95-6cab-43d1-991f-92f9f9572793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915d1fd4-213c-47fe-906c-ffef3186d968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915d1fd4-213c-47fe-906c-ffef3186d968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-954578450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=473f2883-93f0-4d92-9120-ef20170f523d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7da470b07b04649bee9f3346ef00303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:58Z,use_quota=True,user_id='07676288a1d944898e6c98c063a3ecf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea23c5c-6190-4693-93ae-40d75f496ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea23c5c-6190-4693-93ae-40d75f496ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7693845f-390f-49e3-91b6-2d8053a56937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7693845f-390f-49e3-91b6-2d8053a56937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '473f2883-93f0-4d92-9120-ef20170f523d', 'volume_name': 'volume-473f2883-93f0-4d92-9120-ef20170f523d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb00159f-057e-4108-a420-403c08ce5ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb00159f-057e-4108-a420-403c08ce5ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ad0c14-d583-4d32-b4ba-d2efbc075e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:57 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Volume 473f2883-93f0-4d92-9120-ef20170f523d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-473f2883-93f0-4d92-9120-ef20170f523d', 'volume_size': 1} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:57 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d" returned: 0 in 0.834s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.103s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-954578450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=473f2883-93f0-4d92-9120-ef20170f523d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7da470b07b04649bee9f3346ef00303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:03:58Z,use_quota=True,user_id='07676288a1d944898e6c98c063a3ecf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Creating volume 473f2883-93f0-4d92-9120-ef20170f523d {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:03:57 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-473f2883-93f0-4d92-9120-ef20170f523d 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2bc212a-e241-4038-a592-f5ada4d8c3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ffa6e0-7598-4080-a800-68e437cbbd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:57 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-473f2883-93f0-4d92-9120-ef20170f523d 1073741824 Apr 29 09:03:57 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:57 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Volume volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d (e0d583fc-5c36-471f-aade-fcd89f1fb80d): created successfully Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ffa6e0-7598-4080-a800-68e437cbbd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Flow 'volume_create_manager' (65f29c51-231a-4c8e-8c5b-dfc978e89ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:57 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e24d6cd6-5e23-4bd2-a7eb-9dd903c29479 tempest-VolumesSnapshotTestJSON-990983153 None] Created volume successfully. Apr 29 09:03:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:58 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-473f2883-93f0-4d92-9120-ef20170f523d 1073741824" returned: 0 in 0.887s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-473f2883-93f0-4d92-9120-ef20170f523d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:58 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-473f2883-93f0-4d92-9120-ef20170f523d Apr 29 09:03:58 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:59 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-473f2883-93f0-4d92-9120-ef20170f523d" returned: 0 in 0.625s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.307s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ad0c14-d583-4d32-b4ba-d2efbc075e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-473f2883-93f0-4d92-9120-ef20170f523d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3f74fb-1293-415f-8ded-eb8caed9e245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a29be63-5279-41e6-ae35-179d2eb659ee]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:59 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Volume volume-473f2883-93f0-4d92-9120-ef20170f523d (473f2883-93f0-4d92-9120-ef20170f523d): created successfully Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3f74fb-1293-415f-8ded-eb8caed9e245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Flow 'volume_create_manager' (cf6eac95-6cab-43d1-991f-92f9f9572793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:03:59 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-232e6f7e-81c8-4225-bfcd-3b39ffb20c96 tempest-VolumesTransfersTest-951979768 None] Created volume successfully. Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:59 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a Apr 29 09:03:59 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:59 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:03:59 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Acquiring lock "cinder-473f2883-93f0-4d92-9120-ef20170f523d-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Lock "cinder-473f2883-93f0-4d92-9120-ef20170f523d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Acquiring lock "cinder-quobyte-473f2883-93f0-4d92-9120-ef20170f523d" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Lock "cinder-quobyte-473f2883-93f0-4d92-9120-ef20170f523d" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4413ea2-5718-49e0-88d1-712eb8801614]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-473f2883-93f0-4d92-9120-ef20170f523d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:00 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.648s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:04:00 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a" returned: 0 in 0.767s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c3bd4c-7e5b-4f33-bff1-7755f3bec552]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:00 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-473f2883-93f0-4d92-9120-ef20170f523d Apr 29 09:04:00 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:00 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a Apr 29 09:04:00 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:00 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-473f2883-93f0-4d92-9120-ef20170f523d" returned: 0 in 0.777s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-473f2883-93f0-4d92-9120-ef20170f523d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:00 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-473f2883-93f0-4d92-9120-ef20170f523d Apr 29 09:04:00 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:00 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a" returned: 0 in 0.736s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.65b10541-8685-41e9-b02a-074fb988fecfxjvd81v2.img {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:00 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.65b10541-8685-41e9-b02a-074fb988fecfxjvd81v2.img Apr 29 09:04:00 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:01 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-473f2883-93f0-4d92-9120-ef20170f523d" returned: 0 in 0.568s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Lock "cinder-quobyte-473f2883-93f0-4d92-9120-ef20170f523d" released by "delete_volume" :: held 1.402s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:04:01 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Created reservations ['a5e92a80-520d-4639-89c5-23970ee461e4', '4cb9a89f-cedb-42e0-aea5-6f5ab29178d6', '0f8d4b77-8fb6-4a22-a117-b6eea6da92bb', 'ee035d79-cdbe-4a6b-9e36-7dd37f8fd73a'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:04:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:04:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:04:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:01 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:04:01 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:03 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.696s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:03 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:04:03 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Deleted volume successfully. Apr 29 09:04:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-bfa326a2-812b-49fc-be5b-64e85f835157 tempest-VolumesTransfersTest-733685552 None] Lock "cinder-473f2883-93f0-4d92-9120-ef20170f523d-delete_volume" released by "delete_volume" :: held 3.532s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:04:06 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.65b10541-8685-41e9-b02a-074fb988fecfxjvd81v2.img" returned: 0 in 5.303s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:06 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[d657c85b-cc93-4dde-9daf-6317b702e00e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:06 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a Apr 29 09:04:06 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:07 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a" returned: 0 in 0.939s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:07 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.65b10541-8685-41e9-b02a-074fb988fecfxjvd81v2.img {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:04:07 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] Converted 1024.00 MB image at 193.06 MB/s Apr 29 09:04:07 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] 65b10541-8685-41e9-b02a-074fb988fecf was raw, no need to convert to raw {{(pid=83712) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 29 09:04:10 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:04:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Flow 'volume_create_manager' (7a3975ba-8310-441a-bf61-fde8aec84e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:04:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512741ff-701f-486f-9f22-6807ac48ee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512741ff-701f-486f-9f22-6807ac48ee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2027329772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f6b3c2-ec56-4d5c-823e-25f0d55a14b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ad8f05a7cf422b8b20446f877d5b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:04:11Z,use_quota=True,user_id='9dfa1d6f9fb54f52af14bcd145d18799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9494e25f-3d93-4ed4-ab38-9b363298fa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9494e25f-3d93-4ed4-ab38-9b363298fa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba88ca5-37c0-4be0-a54a-3b32eeeab231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba88ca5-37c0-4be0-a54a-3b32eeeab231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f6b3c2-ec56-4d5c-823e-25f0d55a14b1', 'volume_name': 'volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7c4727-bf16-4beb-8313-5261b0753e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7c4727-bf16-4beb-8313-5261b0753e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7d0a2f-2d13-4d36-84ba-64c131723d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:10 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Volume 40f6b3c2-ec56-4d5c-823e-25f0d55a14b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1', 'volume_size': 1} Apr 29 09:04:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:20 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:UPDATE=39,cinder:SELECT=37,cinder:INSERT=10,cinder:DELETE=2 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:04:20 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:UPDATE=40,cinder:SELECT=26,cinder:INSERT=8,cinder:DELETE=5 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:04:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.758s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] Uploaded volume to glance image-id: 65b10541-8685-41e9-b02a-074fb988fecf. {{(pid=83712) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 09:04:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 26.858s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] Creating offline snapshot 028dfb79-88ed-4558-b149-9e0773e163bd of volume e0d583fc-5c36-471f-aade-fcd89f1fb80d {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:04:26 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b11c5988-a28f-4cec-a491-75d89b81ab12 tempest-VolumesActionsTest-874268659 None] Copy volume to image completed successfully. Apr 29 09:04:26 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[b192056a-5419-4a00-a394-50581bc9f324]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:26 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d Apr 29 09:04:26 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:26 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d" returned: 0 in 0.691s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:26 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd 1G Apr 29 09:04:26 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:27 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd 1G" returned: 0 in 0.794s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:27 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd Apr 29 09:04:27 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:28 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd" returned: 0 in 0.651s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:28 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd is being set with open permissions: ugo+rw Apr 29 09:04:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:28 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd Apr 29 09:04:28 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:28 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd" returned: 0 in 0.575s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:28 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.info Apr 29 09:04:28 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:29 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.info" returned: 0 in 0.601s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:29 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.info is being set with open permissions: ugo+rw Apr 29 09:04:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:29 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.info Apr 29 09:04:29 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:30 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.info" returned: 0 in 0.563s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.973s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.368s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2027329772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f6b3c2-ec56-4d5c-823e-25f0d55a14b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ad8f05a7cf422b8b20446f877d5b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:04:11Z,use_quota=True,user_id='9dfa1d6f9fb54f52af14bcd145d18799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Creating volume 40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:04:30 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:30 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 1073741824 Apr 29 09:04:30 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:30 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-76338072-9ea1-4313-95e9-bde50ab603a5 tempest-VolumesSnapshotTestJSON-990983153 None] Create snapshot completed successfully Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-028dfb79-88ed-4558-b149-9e0773e163bd-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-028dfb79-88ed-4558-b149-9e0773e163bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-e0d583fc-5c36-471f-aade-fcd89f1fb80d" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-e0d583fc-5c36-471f-aade-fcd89f1fb80d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:04:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-028dfb79-88ed-4558-b149-9e0773e163bd" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:04:30 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 1073741824" returned: 0 in 0.834s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-028dfb79-88ed-4558-b149-9e0773e163bd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Deleting offline snapshot 028dfb79-88ed-4558-b149-9e0773e163bd of volume e0d583fc-5c36-471f-aade-fcd89f1fb80d {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] snapshot_file for this snap is: volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a14d9f-bf78-4ad9-8813-61ea9b4b38be]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:31 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 Apr 29 09:04:31 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:31 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd Apr 29 09:04:31 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:31 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1" returned: 0 in 0.577s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.551s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7d0a2f-2d13-4d36-84ba-64c131723d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18cd07e4-5d44-4edb-a490-c0367d030c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[4184e7b3-b5cc-49ce-88de-ee9eb816b48b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:31 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Volume volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 (40f6b3c2-ec56-4d5c-823e-25f0d55a14b1): created successfully Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18cd07e4-5d44-4edb-a490-c0367d030c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Flow 'volume_create_manager' (7a3975ba-8310-441a-bf61-fde8aec84e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:04:31 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd" returned: 0 in 0.686s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:04:31 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-df9e6650-6dcc-4466-ad18-37a79ad67b60 tempest-VolumesCloneTest-1696076237 None] Created volume successfully. Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[c362e6f1-0699-44b9-80e5-5d2cec08b8fe]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:31 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a Apr 29 09:04:31 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:31 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d Apr 29 09:04:31 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:32 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a" returned: 0 in 0.837s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[645353fb-e94a-48a8-949d-8d648d6f9cb6]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:04:32 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d" returned: 0 in 0.847s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:32 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd Apr 29 09:04:32 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Flow 'volume_create_manager' (30710e18-c492-41bd-b7c0-d4644a89b71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22bdcc8-9804-4b10-bc48-224d96a7eacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22bdcc8-9804-4b10-bc48-224d96a7eacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-365810411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2e9d1e-0675-499a-883e-3a4cf81e4f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ad8f05a7cf422b8b20446f877d5b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:04:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=40f6b3c2-ec56-4d5c-823e-25f0d55a14b1,status='creating',terminated_at=None,updated_at=2026-04-29T07:04:33Z,use_quota=True,user_id='9dfa1d6f9fb54f52af14bcd145d18799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6583f1dd-bc7a-42e6-bdc0-9945514de193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6583f1dd-bc7a-42e6-bdc0-9945514de193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:32 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230e3637-2b41-4abd-8ba0-8d65458450ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:32 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230e3637-2b41-4abd-8ba0-8d65458450ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3d2e9d1e-0675-499a-883e-3a4cf81e4f84', 'volume_name': 'volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84', 'volume_size': 2, 'source_volid': '40f6b3c2-ec56-4d5c-823e-25f0d55a14b1', 'source_volstatus': 'available'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a84cc7-529a-405e-b528-45d81d09ec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a84cc7-529a-405e-b528-45d81d09ec17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c928b378-579a-4f1d-a3a7-1f60fdf6e714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:32 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Volume 3d2e9d1e-0675-499a-883e-3a4cf81e4f84: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84', 'volume_size': 2, 'source_volid': '40f6b3c2-ec56-4d5c-823e-25f0d55a14b1', 'source_volstatus': 'available'} Apr 29 09:04:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:33 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd" returned: 0 in 0.762s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:33 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a" returned: 0 in 0.843s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:33 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd Apr 29 09:04:33 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:33 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img Apr 29 09:04:33 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:33 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d.028dfb79-88ed-4558-b149-9e0773e163bd" returned: 0 in 0.595s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-028dfb79-88ed-4558-b149-9e0773e163bd" released by "_delete_snapshot" :: held 3.052s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:04:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-e0d583fc-5c36-471f-aade-fcd89f1fb80d" released by "delete_snapshot" :: held 3.093s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:04:34 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Created reservations ['04e42123-a1f5-40c1-b28e-c9444e45008e', '498e97d1-1748-4322-aaa1-282313fc7f27', '8823b21f-1247-4d02-bc70-d62e9895b09e', '09165c00-3c4a-44ba-8170-b415ccbaa195'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:04:34 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Delete snapshot completed successfully. Apr 29 09:04:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b287b8b3-34fa-43a7-9bf5-89e78df56a53 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-028dfb79-88ed-4558-b149-9e0773e163bd-delete_snapshot" released by "delete_snapshot" :: held 3.477s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:04:36 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:04:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Flow 'volume_create_manager' (3f3898a7-1d6a-47d6-b016-28f4c213f1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:04:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e19e834-577e-48ba-a9d9-2f013fd260a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e19e834-577e-48ba-a9d9-2f013fd260a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1717144935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e3f7a3-160f-4abd-826a-a4c16ce1b80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e22b58be31b4643ad84f7a39e81d66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:04:36Z,use_quota=True,user_id='2344d611a1cf4f99b62401465074ccac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe512b7-3d76-4523-a2e0-8b15a4b2cd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe512b7-3d76-4523-a2e0-8b15a4b2cd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9908b27-0554-453f-878f-a9e888eee7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9908b27-0554-453f-878f-a9e888eee7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e3f7a3-160f-4abd-826a-a4c16ce1b80f', 'volume_name': 'volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84c4a8c-dad8-4ce1-baec-8d7eb55e73d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84c4a8c-dad8-4ce1-baec-8d7eb55e73d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7eb86ba-788e-4632-bc60-c2a408e90401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:36 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Volume 30e3f7a3-160f-4abd-826a-a4c16ce1b80f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f', 'volume_size': 1} Apr 29 09:04:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:38 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img" returned: 0 in 4.786s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:38 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cafd3a-134f-4210-97f1-c484d6c7cdd0]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:38 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a Apr 29 09:04:38 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:39 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a" returned: 0 in 0.939s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:39 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:04:39 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Converted 1024.00 MB image at 213.92 MB/s Apr 29 09:04:39 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] e57b862b-640a-4633-acc1-42449eff28e1 was raw, converting to qcow2 {{(pid=83712) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 29 09:04:39 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[3787433e-d60d-4adf-91bb-5fa4b6938a43]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:39 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img Apr 29 09:04:39 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:39 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img" returned: 0 in 0.638s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:39 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img Apr 29 09:04:39 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:40 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img" returned: 1 in 0.718s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:04:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img /opt/stack/data/cinder/conversion/vol_upload_eyikcv_5 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:40 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img /opt/stack/data/cinder/conversion/vol_upload_eyikcv_5 Apr 29 09:04:40 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:41 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img /opt/stack/data/cinder/conversion/vol_upload_eyikcv_5" returned: 0 in 0.887s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:41 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Image conversion details: src /opt/stack/data/cinder/conversion/79e26a7b-283f-411c-a465-ff2bf65b7a4a.temp_image.e57b862b-640a-4633-acc1-42449eff28e1ejkv3bto.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_eyikcv_5 {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:04:41 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 29 09:04:41 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa71321c-05ba-474f-8498-05b0cc15f361]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eyikcv_5 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:41 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eyikcv_5 Apr 29 09:04:41 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:42 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eyikcv_5" returned: 0 in 0.630s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.663s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Uploaded volume to glance image-id: e57b862b-640a-4633-acc1-42449eff28e1. {{(pid=83712) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 09:04:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 10.568s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:43 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Cloning volume 40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 to volume 3d2e9d1e-0675-499a-883e-3a4cf81e4f84 Apr 29 09:04:43 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e3c73f2f-cb9d-4d55-9169-13c68edc37c3 tempest-VolumesActionsTest-874268659 None] Copy volume to image completed successfully. Apr 29 09:04:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Creating offline snapshot 64e0ea99-11f4-4535-ae75-1b5e14683e30 of volume 40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:04:43 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[76970cb0-e020-4e83-9e2e-3d5c65ea0745]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:43 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 Apr 29 09:04:43 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:44 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1" returned: 0 in 0.725s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:44 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 1G Apr 29 09:04:44 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Acquiring lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:04:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:04:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Acquiring lock "cinder-quobyte-79e26a7b-283f-411c-a465-ff2bf65b7a4a" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:04:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Lock "cinder-quobyte-79e26a7b-283f-411c-a465-ff2bf65b7a4a" acquired by "delete_volume" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:04:44 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5df076-d23d-4aa1-97d3-45a64193f2b7]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:44 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a Apr 29 09:04:44 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:44 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 1G" returned: 0 in 0.879s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:45 devstack sudo[91480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 Apr 29 09:04:45 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:45 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a" returned: 0 in 0.762s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:45 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a Apr 29 09:04:45 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:45 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30" returned: 0 in 0.645s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:45 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 is being set with open permissions: ugo+rw Apr 29 09:04:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:45 devstack sudo[91490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 Apr 29 09:04:45 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:45 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-79e26a7b-283f-411c-a465-ff2bf65b7a4a" returned: 0 in 0.628s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Lock "cinder-quobyte-79e26a7b-283f-411c-a465-ff2bf65b7a4a" released by "delete_volume" :: held 1.437s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Created reservations ['340202be-c426-4a9d-ab57-2bb243eb553e', 'e89c418a-da1f-4b1f-a79d-31e3adf20181', '7c67df76-dece-42e0-8612-d347b9580f0e', 'a67c9da6-0b12-4e6d-8433-2cbacbd58cc5'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:46 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:04:46 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:46 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30" returned: 0 in 0.637s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:46 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.info Apr 29 09:04:46 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:46 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.613s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:04:46 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Deleted volume successfully. Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-994c95be-0abc-4da5-86cc-0bd5da2a042e tempest-VolumesActionsTest-874268659 None] Lock "cinder-79e26a7b-283f-411c-a465-ff2bf65b7a4a-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:04:46 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.info" returned: 0 in 0.624s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:46 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.info is being set with open permissions: ugo+rw Apr 29 09:04:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:46 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.info Apr 29 09:04:46 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:47 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.info" returned: 0 in 0.594s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Acquiring lock "cinder-quobyte-3d2e9d1e-0675-499a-883e-3a4cf81e4f84" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:04:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Lock "cinder-quobyte-3d2e9d1e-0675-499a-883e-3a4cf81e4f84" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:04:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] snapshot: 64e0ea99-11f4-4535-ae75-1b5e14683e30, volume: 3d2e9d1e-0675-499a-883e-3a4cf81e4f84, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:04:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:04:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:04:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:47 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[82160f63-44ad-4ddd-a01e-afb8c8c7f1d4]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:47 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 Apr 29 09:04:47 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:48 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30" returned: 0 in 0.742s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:04:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:04:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:04:48 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7413053-e043-4037-bbd8-2fabd65abe94]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:48 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 Apr 29 09:04:48 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:49 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1" returned: 0 in 0.736s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:49 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84 not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:04:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:49 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84 Apr 29 09:04:49 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:54 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84" returned: 0 in 5.520s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:54 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67e3f8e-f3b3-4283-aac7-9e89afacd5cb]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:54 devstack sudo[91531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 Apr 29 09:04:54 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Flow 'volume_create_manager' (f58f1457-9374-4791-bdf2-a2ccf31bff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7853d9-82d5-48e3-87b6-29357ade4820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7853d9-82d5-48e3-87b6-29357ade4820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1079949281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e97340d-32f7-4cef-92c6-75e919a325e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487badfe98d84309b50978c23b3cc572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:04:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:04:55Z,use_quota=True,user_id='7390dbbde4c4410abcf66464489b7f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199b175e-34d1-4c45-978b-c0f1a833eebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199b175e-34d1-4c45-978b-c0f1a833eebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731c1023-a8d8-4307-9291-d8e49a259674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731c1023-a8d8-4307-9291-d8e49a259674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e97340d-32f7-4cef-92c6-75e919a325e0', 'volume_name': 'volume-4e97340d-32f7-4cef-92c6-75e919a325e0', 'volume_size': 2}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd364273-f510-4068-8491-81853e9cc0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd364273-f510-4068-8491-81853e9cc0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d78a1c7-cda7-48b7-ad4f-b7ead872433c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:55 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Volume 4e97340d-32f7-4cef-92c6-75e919a325e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e97340d-32f7-4cef-92c6-75e919a325e0', 'volume_size': 2} Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:55 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1" returned: 0 in 0.886s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84 {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:04:55 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Converted 1024.00 MB image at 185.48 MB/s Apr 29 09:04:55 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84 is being set with open permissions: ugo+rw Apr 29 09:04:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:55 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84 Apr 29 09:04:55 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:56 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84" returned: 0 in 0.583s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:56 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Lock "cinder-quobyte-3d2e9d1e-0675-499a-883e-3a4cf81e4f84" released by "_copy_volume_from_snapshot" :: held 8.545s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:04:56 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Acquiring lock "cinder-quobyte-64e0ea99-11f4-4535-ae75-1b5e14683e30" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:04:56 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Lock "cinder-quobyte-64e0ea99-11f4-4535-ae75-1b5e14683e30" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:04:56 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Deleting offline snapshot 64e0ea99-11f4-4535-ae75-1b5e14683e30 of volume 40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:04:56 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] snapshot_file for this snap is: volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:04:56 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fbbf57-7962-42e0-af74-0c2d8195bc18]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:56 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 Apr 29 09:04:56 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:56 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30" returned: 0 in 0.718s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:56 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:04:56 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[3781627f-d242-48aa-8513-a8dcaf80b14f]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:56 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 Apr 29 09:04:56 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:57 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1" returned: 0 in 0.704s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:57 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 Apr 29 09:04:57 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:58 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30" returned: 0 in 0.677s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:58 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30 Apr 29 09:04:58 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:58 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1.64e0ea99-11f4-4535-ae75-1b5e14683e30" returned: 0 in 0.591s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Lock "cinder-quobyte-64e0ea99-11f4-4535-ae75-1b5e14683e30" released by "_delete_snapshot" :: held 2.774s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.600s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.104s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1717144935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e3f7a3-160f-4abd-826a-a4c16ce1b80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e22b58be31b4643ad84f7a39e81d66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:04:36Z,use_quota=True,user_id='2344d611a1cf4f99b62401465074ccac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Creating volume 30e3f7a3-160f-4abd-826a-a4c16ce1b80f {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:04:58 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:58 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f 1073741824 Apr 29 09:04:58 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c928b378-579a-4f1d-a3a7-1f60fdf6e714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84', 'volume_size': 2, 'source_volid': '40f6b3c2-ec56-4d5c-823e-25f0d55a14b1', 'source_volstatus': 'available'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58927d27-1b42-48c4-b6ff-a77406b38d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:58 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Volume volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84 (3d2e9d1e-0675-499a-883e-3a4cf81e4f84): created successfully Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58927d27-1b42-48c4-b6ff-a77406b38d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Flow 'volume_create_manager' (30710e18-c492-41bd-b7c0-d4644a89b71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:04:59 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-eb7ed088-866b-49ef-a135-3304a9d74579 tempest-VolumesCloneTest-1696076237 None] Created volume successfully. Apr 29 09:04:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:04:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:04:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:04:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:59 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:04:59 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:59 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f 1073741824" returned: 0 in 0.811s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:59 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f Apr 29 09:04:59 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Acquiring lock "cinder-3d2e9d1e-0675-499a-883e-3a4cf81e4f84-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:04:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Lock "cinder-3d2e9d1e-0675-499a-883e-3a4cf81e4f84-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Acquiring lock "cinder-quobyte-3d2e9d1e-0675-499a-883e-3a4cf81e4f84" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Lock "cinder-quobyte-3d2e9d1e-0675-499a-883e-3a4cf81e4f84" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[df377499-1444-49df-b6ad-7d17f67a9bdb]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:00 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.632s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:00 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84 Apr 29 09:05:00 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:00 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" returned: 0 in 0.770s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.243s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1079949281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e97340d-32f7-4cef-92c6-75e919a325e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487badfe98d84309b50978c23b3cc572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:04:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:04:55Z,use_quota=True,user_id='7390dbbde4c4410abcf66464489b7f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Creating volume 4e97340d-32f7-4cef-92c6-75e919a325e0 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:00 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4e97340d-32f7-4cef-92c6-75e919a325e0 2147483648 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7eb86ba-788e-4632-bc60-c2a408e90401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de40b53-a236-498f-abfc-0b9cf629d028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:00 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4e97340d-32f7-4cef-92c6-75e919a325e0 2147483648 Apr 29 09:05:00 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:00 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Volume volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f (30e3f7a3-160f-4abd-826a-a4c16ce1b80f): created successfully Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de40b53-a236-498f-abfc-0b9cf629d028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Flow 'volume_create_manager' (3f3898a7-1d6a-47d6-b016-28f4c213f1c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:00 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-004bf730-aa72-4b71-b50f-be7ec0a7a814 tempest-VolumesSnapshotTestJSON-990983153 None] Created volume successfully. Apr 29 09:05:00 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84" returned: 0 in 0.760s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:00 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84 Apr 29 09:05:00 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:01 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4e97340d-32f7-4cef-92c6-75e919a325e0 2147483648" returned: 0 in 0.904s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4e97340d-32f7-4cef-92c6-75e919a325e0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:01 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4e97340d-32f7-4cef-92c6-75e919a325e0 Apr 29 09:05:01 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:01 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3d2e9d1e-0675-499a-883e-3a4cf81e4f84" returned: 0 in 0.738s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Lock "cinder-quobyte-3d2e9d1e-0675-499a-883e-3a4cf81e4f84" released by "delete_volume" :: held 1.558s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:01 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Created reservations ['1eff537d-7735-4d5d-828e-5886777e7c7b', 'bcd2b64e-b0a8-480b-ad93-e3e1fc8b7c1b', '0dee73b8-5304-4648-919f-a2061c123aaf', 'f48d6a15-ed59-49fe-9b64-b11172102044'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:01 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:05:01 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:02 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4e97340d-32f7-4cef-92c6-75e919a325e0" returned: 0 in 0.636s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.535s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d78a1c7-cda7-48b7-ad4f-b7ead872433c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e97340d-32f7-4cef-92c6-75e919a325e0', 'volume_size': 2}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02459be-9d69-4975-985c-2aad1f8af4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] Creating offline snapshot 80692478-1083-4c1c-b6ee-f0a17d327adf of volume 30e3f7a3-160f-4abd-826a-a4c16ce1b80f {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:05:02 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Volume volume-4e97340d-32f7-4cef-92c6-75e919a325e0 (4e97340d-32f7-4cef-92c6-75e919a325e0): created successfully Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02459be-9d69-4975-985c-2aad1f8af4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Flow 'volume_create_manager' (f58f1457-9374-4791-bdf2-a2ccf31bff4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[31be2063-8579-457b-81eb-20fd7e236fdd]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Acquiring lock "cinder-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:02 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ead78845-31d7-4006-b94b-88cafb4b3786 tempest-VolumesCloneNegativeTest-1577983308 None] Created volume successfully. Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Lock "cinder-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Acquiring lock "cinder-quobyte-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Lock "cinder-quobyte-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1" acquired by "delete_volume" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:02 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:02 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f Apr 29 09:05:02 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.662s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:02 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Deleted volume successfully. Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e98f42-063c-4f15-bd71-68fe0dce2de9]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c17e659e-c015-4e5a-9147-b9dd32e70826 tempest-VolumesCloneTest-1696076237 None] Lock "cinder-3d2e9d1e-0675-499a-883e-3a4cf81e4f84-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:02 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 Apr 29 09:05:02 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Acquiring lock "cinder-4e97340d-32f7-4cef-92c6-75e919a325e0-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Lock "cinder-4e97340d-32f7-4cef-92c6-75e919a325e0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Acquiring lock "cinder-quobyte-4e97340d-32f7-4cef-92c6-75e919a325e0" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Lock "cinder-quobyte-4e97340d-32f7-4cef-92c6-75e919a325e0" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3d28d9-6a44-4ff9-913c-2f5d88c2740a]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4e97340d-32f7-4cef-92c6-75e919a325e0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:03 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" returned: 0 in 0.855s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:03 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4e97340d-32f7-4cef-92c6-75e919a325e0 Apr 29 09:05:03 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:03 devstack sudo[91603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf 1G Apr 29 09:05:03 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:03 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1" returned: 0 in 0.846s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:03 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1 Apr 29 09:05:03 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:03 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4e97340d-32f7-4cef-92c6-75e919a325e0" returned: 0 in 0.776s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4e97340d-32f7-4cef-92c6-75e919a325e0 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:03 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4e97340d-32f7-4cef-92c6-75e919a325e0 Apr 29 09:05:03 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:03 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf 1G" returned: 0 in 0.794s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:03 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1" returned: 0 in 0.627s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:03 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf Apr 29 09:05:03 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Lock "cinder-quobyte-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1" released by "delete_volume" :: held 1.550s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:03 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Created reservations ['683e9725-76d7-4b81-b64a-a1c5a46d53b3', 'ebded6fd-beac-4e92-897d-ea69a241ca91', 'c2fbe7d6-a5a1-47dc-9de3-310d4b071ee7', '5df4845c-0d31-4e51-9c02-799860b91d4e'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:04 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:05:04 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:04 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4e97340d-32f7-4cef-92c6-75e919a325e0" returned: 0 in 0.644s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Lock "cinder-quobyte-4e97340d-32f7-4cef-92c6-75e919a325e0" released by "delete_volume" :: held 1.469s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Created reservations ['faff09b7-921a-4976-9b12-a41261422c91', '97cb6369-a0f0-4ce2-a38b-0078f4e97ce1', 'c04de458-65bd-4eb5-900c-90706ff31033', '583e26d5-c369-4504-8723-4d781c310406'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:04 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf" returned: 0 in 0.723s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:04 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf is being set with open permissions: ugo+rw Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:04 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:05:04 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:04 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf Apr 29 09:05:04 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:04 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.630s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:04 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Deleted volume successfully. Apr 29 09:05:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-13c93d6e-8812-4851-82cf-c631f7c8c4c3 tempest-VolumesCloneTest-1696076237 None] Lock "cinder-40f6b3c2-ec56-4d5c-823e-25f0d55a14b1-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:05 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf" returned: 0 in 0.669s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:05 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.690s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:05 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:05 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Deleted volume successfully. Apr 29 09:05:05 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-af1fd951-16b3-466e-b014-67c7a7a54c68 tempest-VolumesCloneNegativeTest-1577983308 None] Lock "cinder-4e97340d-32f7-4cef-92c6-75e919a325e0-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:05 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.info Apr 29 09:05:05 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:06 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.info" returned: 0 in 0.680s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:06 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.info is being set with open permissions: ugo+rw Apr 29 09:05:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:06 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.info Apr 29 09:05:06 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:06 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.info" returned: 0 in 0.757s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.662s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:06 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c46ebf35-f745-419f-8563-c98ce56180b4 tempest-VolumesSnapshotTestJSON-990983153 None] Create snapshot completed successfully Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Flow 'volume_create_manager' (b8c8b25c-6119-4504-9a9a-b104508379c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9e907f-7cb4-4bb6-86c1-b176bd1586bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9e907f-7cb4-4bb6-86c1-b176bd1586bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-194848046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2b76c7-155f-47b8-bc0a-2c8048d8f978,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d58a9b5f1f8452ebef91580bdbdd066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:08Z,use_quota=True,user_id='0c468b9cddee4dbfb037c2a7903ab2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0fa5ab-a07f-4f8c-b31d-187b6f48573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0fa5ab-a07f-4f8c-b31d-187b6f48573a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cad223-2d1f-4999-9ad6-e190e3abeb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cad223-2d1f-4999-9ad6-e190e3abeb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2b76c7-155f-47b8-bc0a-2c8048d8f978', 'volume_name': 'volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8405d4-c653-4cc6-9a12-95221f8a2083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8405d4-c653-4cc6-9a12-95221f8a2083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdc4a94-731e-4a24-8905-d959cef134f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:07 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Volume 9d2b76c7-155f-47b8-bc0a-2c8048d8f978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978', 'volume_size': 1} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-194848046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2b76c7-155f-47b8-bc0a-2c8048d8f978,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d58a9b5f1f8452ebef91580bdbdd066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:08Z,use_quota=True,user_id='0c468b9cddee4dbfb037c2a7903ab2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Creating volume 9d2b76c7-155f-47b8-bc0a-2c8048d8f978 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:07 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:05:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:07 devstack sudo[91640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978 1073741824 Apr 29 09:05:07 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Flow 'volume_create_manager' (4a13472d-df12-4789-b72b-938f8bb6e142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23453984-f8b9-4f01-8dd3-6ecb346fb193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23453984-f8b9-4f01-8dd3-6ecb346fb193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-127822673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9522507f-e3f5-4af9-95ea-895d9cc5d9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e22b58be31b4643ad84f7a39e81d66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=80692478-1083-4c1c-b6ee-f0a17d327adf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:08Z,use_quota=True,user_id='2344d611a1cf4f99b62401465074ccac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55c84ea-445f-4726-b77c-2f2f3c0f4aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55c84ea-445f-4726-b77c-2f2f3c0f4aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c81f3a4-cb7b-4391-bf1b-d9df68759d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c81f3a4-cb7b-4391-bf1b-d9df68759d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9522507f-e3f5-4af9-95ea-895d9cc5d9af', 'volume_name': 'volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af', 'volume_size': 2, 'snapshot_id': '80692478-1083-4c1c-b6ee-f0a17d327adf'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d043da46-c9f9-4579-a0e7-81f2ae62ce8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d043da46-c9f9-4579-a0e7-81f2ae62ce8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb05913-6931-4d19-8d4f-0439a4c6c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:08 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Volume 9522507f-e3f5-4af9-95ea-895d9cc5d9af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af', 'volume_size': 2, 'snapshot_id': '80692478-1083-4c1c-b6ee-f0a17d327adf'} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:08 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978 1073741824" returned: 0 in 0.934s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (1e16dc22-8c81-49c2-b6d2-534d13f8ab4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fdf337-7585-4004-a736-3f6b92c59a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fdf337-7585-4004-a736-3f6b92c59a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-488140436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d0688f-90a0-4803-a042-0e8522b0aeb6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:09Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30acbd5-51ce-4e2e-8750-2ddfcb1981e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30acbd5-51ce-4e2e-8750-2ddfcb1981e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcab0fa-701f-4c28-a72e-c0b674d761ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcab0fa-701f-4c28-a72e-c0b674d761ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d0688f-90a0-4803-a042-0e8522b0aeb6', 'volume_name': 'volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa8ded4a-5a5c-4947-af93-cf8016b5cb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa8ded4a-5a5c-4947-af93-cf8016b5cb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37590bed-0780-49a4-a7f7-f77760730c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:08 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Volume c7d0688f-90a0-4803-a042-0e8522b0aeb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6', 'volume_size': 1} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:08 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978 Apr 29 09:05:08 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:09 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978" returned: 0 in 0.592s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.872s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-80692478-1083-4c1c-b6ee-f0a17d327adf-9522507f-e3f5-4af9-95ea-895d9cc5d9af" by "_create_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdc4a94-731e-4a24-8905-d959cef134f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336fbb84-9be1-4fdf-8d03-b9a167ce3cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-80692478-1083-4c1c-b6ee-f0a17d327adf-9522507f-e3f5-4af9-95ea-895d9cc5d9af" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Creating volume 9522507f-e3f5-4af9-95ea-895d9cc5d9af from snapshot 80692478-1083-4c1c-b6ee-f0a17d327adf {{(pid=83712) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-9522507f-e3f5-4af9-95ea-895d9cc5d9af" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:09 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Volume volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978 (9d2b76c7-155f-47b8-bc0a-2c8048d8f978): created successfully Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336fbb84-9be1-4fdf-8d03-b9a167ce3cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Flow 'volume_create_manager' (b8c8b25c-6119-4504-9a9a-b104508379c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-9522507f-e3f5-4af9-95ea-895d9cc5d9af" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] snapshot: 80692478-1083-4c1c-b6ee-f0a17d327adf, volume: 9522507f-e3f5-4af9-95ea-895d9cc5d9af, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:05:09 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-bd613d73-4390-4d32-a3eb-ac64e2a05898 tempest-VolumesListTestJSON-1172242369 None] Created volume successfully. Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[683e697b-5d25-4af0-a780-3d5ffb436df5]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:09 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf Apr 29 09:05:09 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Flow 'volume_create_manager' (33eb3bae-97b0-4100-b8bd-eb646254814b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:10 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1362fb97-7653-4107-b38a-9a7e90056629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf" returned: 0 in 0.725s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1362fb97-7653-4107-b38a-9a7e90056629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-424061741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f41668-ef22-4150-89df-28905b4d5607,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d58a9b5f1f8452ebef91580bdbdd066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:10Z,use_quota=True,user_id='0c468b9cddee4dbfb037c2a7903ab2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12000f76-1501-4d21-ab3f-4e89ff384b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12000f76-1501-4d21-ab3f-4e89ff384b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e9ffa82-08e8-4f4d-b173-cd1795930dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e9ffa82-08e8-4f4d-b173-cd1795930dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f41668-ef22-4150-89df-28905b4d5607', 'volume_name': 'volume-32f41668-ef22-4150-89df-28905b4d5607', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f04f519-e142-43da-8e49-777ff3ea903d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f04f519-e142-43da-8e49-777ff3ea903d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97c08f7-48b6-4e70-b045-ec26a7140268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:10 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Volume 32f41668-ef22-4150-89df-28905b4d5607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f41668-ef22-4150-89df-28905b4d5607', 'volume_size': 1} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2b5c23-8609-4b06-b2a0-c6f763b49c9a]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:10 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f Apr 29 09:05:10 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:11 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" returned: 0 in 0.682s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:11 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:05:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:11 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af Apr 29 09:05:11 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:15 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af" returned: 0 in 4.571s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:15 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f0a99c-a49e-44a0-8b1e-880eec0e409c]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:15 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f Apr 29 09:05:15 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:16 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" returned: 0 in 0.828s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:16 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f, size 1024.00 MB, duration 4.57 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:05:16 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Converted 1024.00 MB image at 223.96 MB/s Apr 29 09:05:16 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af is being set with open permissions: ugo+rw Apr 29 09:05:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:16 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af Apr 29 09:05:16 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:17 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af" returned: 0 in 0.611s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-9522507f-e3f5-4af9-95ea-895d9cc5d9af" released by "_copy_volume_from_snapshot" :: held 7.592s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-80692478-1083-4c1c-b6ee-f0a17d327adf-9522507f-e3f5-4af9-95ea-895d9cc5d9af" released by "_create_volume_from_snapshot" :: held 7.637s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.670s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.272s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-488140436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d0688f-90a0-4803-a042-0e8522b0aeb6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:09Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Creating volume c7d0688f-90a0-4803-a042-0e8522b0aeb6 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:17 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:17 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6 1073741824 Apr 29 09:05:17 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb05913-6931-4d19-8d4f-0439a4c6c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af', 'volume_size': 2, 'snapshot_id': '80692478-1083-4c1c-b6ee-f0a17d327adf'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666a393c-1a68-4464-ab64-d921f1d1b1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:17 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Volume volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af (9522507f-e3f5-4af9-95ea-895d9cc5d9af): created successfully Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666a393c-1a68-4464-ab64-d921f1d1b1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Flow 'volume_create_manager' (4a13472d-df12-4789-b72b-938f8bb6e142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:17 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c2e83a14-8603-4b67-9459-b7eedb03eb9c tempest-VolumesSnapshotTestJSON-990983153 None] Created volume successfully. Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-9522507f-e3f5-4af9-95ea-895d9cc5d9af-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-9522507f-e3f5-4af9-95ea-895d9cc5d9af-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-9522507f-e3f5-4af9-95ea-895d9cc5d9af" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-9522507f-e3f5-4af9-95ea-895d9cc5d9af" acquired by "delete_volume" :: waited 0.014s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d442c92-48e0-4ac5-99fc-613d40c37146]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:17 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6 1073741824" returned: 0 in 0.811s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:17 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af Apr 29 09:05:17 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:17 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6 Apr 29 09:05:17 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:18 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6" returned: 0 in 0.576s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.169s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-424061741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f41668-ef22-4150-89df-28905b4d5607,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d58a9b5f1f8452ebef91580bdbdd066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:10Z,use_quota=True,user_id='0c468b9cddee4dbfb037c2a7903ab2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Creating volume 32f41668-ef22-4150-89df-28905b4d5607 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:18 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-32f41668-ef22-4150-89df-28905b4d5607 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:18 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af" returned: 0 in 0.749s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:18 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-32f41668-ef22-4150-89df-28905b4d5607 1073741824 Apr 29 09:05:18 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37590bed-0780-49a4-a7f7-f77760730c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3137f3b-41a7-4a85-86e3-03814242e0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:18 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af Apr 29 09:05:18 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:18 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Volume volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6 (c7d0688f-90a0-4803-a042-0e8522b0aeb6): created successfully Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3137f3b-41a7-4a85-86e3-03814242e0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (1e16dc22-8c81-49c2-b6d2-534d13f8ab4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:18 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-0e7324f4-5e04-4921-8698-2c97304632c2 tempest-VolumesGetTest-1548789976 None] Created volume successfully. Apr 29 09:05:19 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9522507f-e3f5-4af9-95ea-895d9cc5d9af" returned: 0 in 0.666s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-9522507f-e3f5-4af9-95ea-895d9cc5d9af" released by "delete_volume" :: held 1.457s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Created reservations ['4aa139f8-e1ee-47a4-889a-74093a692ab9', '7bfbdd8a-309f-4a2a-8e38-30d0f0822fd5', '287d1185-a9d4-453c-beb3-4ecfe9cc019c', '0c42f149-3947-4236-b7cd-b68cfbd6f58e'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:19 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-32f41668-ef22-4150-89df-28905b4d5607 1073741824" returned: 0 in 0.791s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-32f41668-ef22-4150-89df-28905b4d5607 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:19 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:05:19 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:19 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-32f41668-ef22-4150-89df-28905b4d5607 Apr 29 09:05:19 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:19 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.644s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:19 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:20 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Deleted volume successfully. Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-80692478-1083-4c1c-b6ee-f0a17d327adf-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-80692478-1083-4c1c-b6ee-f0a17d327adf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6d43416-db7f-4d6f-9ab8-1b6fcb21fd78 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-9522507f-e3f5-4af9-95ea-895d9cc5d9af-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:20 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-80692478-1083-4c1c-b6ee-f0a17d327adf" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-32f41668-ef22-4150-89df-28905b4d5607" returned: 0 in 0.709s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-80692478-1083-4c1c-b6ee-f0a17d327adf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Deleting offline snapshot 80692478-1083-4c1c-b6ee-f0a17d327adf of volume 30e3f7a3-160f-4abd-826a-a4c16ce1b80f {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] snapshot_file for this snap is: volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97c08f7-48b6-4e70-b045-ec26a7140268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f41668-ef22-4150-89df-28905b4d5607', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d242f49-1b28-475b-b7b8-51bf00d72219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aacc5a-e981-4923-af3f-50029534213d]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:20 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Volume volume-32f41668-ef22-4150-89df-28905b4d5607 (32f41668-ef22-4150-89df-28905b4d5607): created successfully Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d242f49-1b28-475b-b7b8-51bf00d72219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Flow 'volume_create_manager' (33eb3bae-97b0-4100-b8bd-eb646254814b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:20 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a0462ace-c95b-40ba-90e8-c5cc6cd32832 tempest-VolumesListTestJSON-1172242369 None] Created volume successfully. Apr 29 09:05:20 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf Apr 29 09:05:20 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (c609601c-0de9-40c5-b8ce-b0a32321c8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c26fe31-3ce1-498b-b9f8-2f0926a32cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c26fe31-3ce1-498b-b9f8-2f0926a32cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-722391160',display_name='tempest-VolumesGetTest-Volume-1795264310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9c2982-fbec-4800-911c-3cece201a886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:20Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f5e7b0-eb61-4817-b929-caf6639319ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f5e7b0-eb61-4817-b929-caf6639319ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea5a4b0-201f-4376-8eda-7b29a2bbd56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea5a4b0-201f-4376-8eda-7b29a2bbd56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9c2982-fbec-4800-911c-3cece201a886', 'volume_name': 'volume-ac9c2982-fbec-4800-911c-3cece201a886', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6267d21d-cd0b-4c18-bf12-23fbbaa94ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6267d21d-cd0b-4c18-bf12-23fbbaa94ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a900b3ec-cc34-44f1-80dc-ca02f979b97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:20 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Volume ac9c2982-fbec-4800-911c-3cece201a886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9c2982-fbec-4800-911c-3cece201a886', 'volume_size': 1} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-722391160',display_name='tempest-VolumesGetTest-Volume-1795264310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9c2982-fbec-4800-911c-3cece201a886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:20Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Creating volume ac9c2982-fbec-4800-911c-3cece201a886 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:20 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ac9c2982-fbec-4800-911c-3cece201a886 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:20 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ac9c2982-fbec-4800-911c-3cece201a886 1073741824 Apr 29 09:05:20 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:20 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf" returned: 0 in 0.768s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b19f02-59cf-4705-acf8-9455ab36ec80]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:21 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f Apr 29 09:05:21 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:21 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ac9c2982-fbec-4800-911c-3cece201a886 1073741824" returned: 0 in 0.999s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=62,cinder:UPDATE=74,cinder:INSERT=16,cinder:DELETE=7 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=70,cinder:UPDATE=76,cinder:INSERT=19,cinder:DELETE=8 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ac9c2982-fbec-4800-911c-3cece201a886 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:21 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ac9c2982-fbec-4800-911c-3cece201a886 Apr 29 09:05:21 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Flow 'volume_create_manager' (5c67a1bb-773b-483a-9bc3-500c1f9931a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab690cd-690f-4b2c-8bd9-e075e9ef62f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab690cd-690f-4b2c-8bd9-e075e9ef62f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1736512227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c9172f-72d3-43f8-99bc-00485945d9a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d58a9b5f1f8452ebef91580bdbdd066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:22Z,use_quota=True,user_id='0c468b9cddee4dbfb037c2a7903ab2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd54634-6224-4c20-a339-9b21716fcdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd54634-6224-4c20-a339-9b21716fcdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92702687-daea-49cb-8338-2d583e520f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92702687-daea-49cb-8338-2d583e520f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c9172f-72d3-43f8-99bc-00485945d9a3', 'volume_name': 'volume-54c9172f-72d3-43f8-99bc-00485945d9a3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6a561e-362f-4fe1-915a-a9fe8292b640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6a561e-362f-4fe1-915a-a9fe8292b640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e5e565-67bd-4367-b299-c12bbc6c1cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:21 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Volume 54c9172f-72d3-43f8-99bc-00485945d9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c9172f-72d3-43f8-99bc-00485945d9a3', 'volume_size': 1} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:21 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" returned: 0 in 1.010s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:21 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf Apr 29 09:05:21 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:22 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ac9c2982-fbec-4800-911c-3cece201a886" returned: 0 in 0.740s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.596s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1736512227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c9172f-72d3-43f8-99bc-00485945d9a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d58a9b5f1f8452ebef91580bdbdd066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:22Z,use_quota=True,user_id='0c468b9cddee4dbfb037c2a7903ab2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Creating volume 54c9172f-72d3-43f8-99bc-00485945d9a3 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:22 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-54c9172f-72d3-43f8-99bc-00485945d9a3 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a900b3ec-cc34-44f1-80dc-ca02f979b97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9c2982-fbec-4800-911c-3cece201a886', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:22 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-54c9172f-72d3-43f8-99bc-00485945d9a3 1073741824 Apr 29 09:05:22 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97b52bc-3bb8-4929-8e2c-340fc49448f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:22 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Volume volume-ac9c2982-fbec-4800-911c-3cece201a886 (ac9c2982-fbec-4800-911c-3cece201a886): created successfully Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97b52bc-3bb8-4929-8e2c-340fc49448f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (c609601c-0de9-40c5-b8ce-b0a32321c8a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:22 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-376a13fd-5ad4-467e-a76e-233786038d31 tempest-VolumesGetTest-1548789976 None] Created volume successfully. Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-ac9c2982-fbec-4800-911c-3cece201a886-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Lock "cinder-ac9c2982-fbec-4800-911c-3cece201a886-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:22 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf" returned: 0 in 0.858s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:22 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf Apr 29 09:05:22 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-quobyte-ac9c2982-fbec-4800-911c-3cece201a886" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-ac9c2982-fbec-4800-911c-3cece201a886" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[529bc022-dafc-42ea-9cbd-d5de0a439760]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ac9c2982-fbec-4800-911c-3cece201a886 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:23 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ac9c2982-fbec-4800-911c-3cece201a886 Apr 29 09:05:23 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:23 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-54c9172f-72d3-43f8-99bc-00485945d9a3 1073741824" returned: 0 in 0.958s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-54c9172f-72d3-43f8-99bc-00485945d9a3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:23 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-54c9172f-72d3-43f8-99bc-00485945d9a3 Apr 29 09:05:23 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:23 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f.80692478-1083-4c1c-b6ee-f0a17d327adf" returned: 0 in 0.796s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-80692478-1083-4c1c-b6ee-f0a17d327adf" released by "_delete_snapshot" :: held 3.577s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" released by "delete_snapshot" :: held 3.612s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:23 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Created reservations ['67175e71-2d3d-4322-acd8-66b3d8701f72', '6e9bb9be-f570-4a84-89f3-fbbbc0f44d53', '3412afe4-f98e-449a-b73a-1ca1db0512be', '6f37db76-0940-4cb9-9cfb-b8ef48ef6141'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:23 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Delete snapshot completed successfully. Apr 29 09:05:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd55a615-7d5a-4f8d-aca1-6b46af3f69e9 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-80692478-1083-4c1c-b6ee-f0a17d327adf-delete_snapshot" released by "delete_snapshot" :: held 3.782s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:23 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ac9c2982-fbec-4800-911c-3cece201a886" returned: 0 in 0.984s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ac9c2982-fbec-4800-911c-3cece201a886 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:23 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ac9c2982-fbec-4800-911c-3cece201a886 Apr 29 09:05:23 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:24 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-54c9172f-72d3-43f8-99bc-00485945d9a3" returned: 0 in 0.747s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e5e565-67bd-4367-b299-c12bbc6c1cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c9172f-72d3-43f8-99bc-00485945d9a3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d88513b-5c89-4c42-857e-5d8414191c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:24 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Volume volume-54c9172f-72d3-43f8-99bc-00485945d9a3 (54c9172f-72d3-43f8-99bc-00485945d9a3): created successfully Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d88513b-5c89-4c42-857e-5d8414191c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Flow 'volume_create_manager' (5c67a1bb-773b-483a-9bc3-500c1f9931a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:24 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-73efbd53-b2cb-4407-adc1-dcd82e1b7839 tempest-VolumesListTestJSON-1172242369 None] Created volume successfully. Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-30e3f7a3-160f-4abd-826a-a4c16ce1b80f-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-30e3f7a3-160f-4abd-826a-a4c16ce1b80f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" acquired by "delete_volume" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6d4e51-879e-4d55-b24e-f56ddbdb2608]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:24 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f Apr 29 09:05:24 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:24 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ac9c2982-fbec-4800-911c-3cece201a886" returned: 0 in 0.729s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-ac9c2982-fbec-4800-911c-3cece201a886" released by "delete_volume" :: held 1.772s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Created reservations ['08433340-c291-4c45-88f0-e5ebf38677e0', '518ee37b-c658-4950-a085-153977b4d141', '956987e0-664e-4d15-b743-753f79c09765', '08bf6a93-ec9d-4d2b-8d24-9671dd52520c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:24 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:05:24 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-c7d0688f-90a0-4803-a042-0e8522b0aeb6-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Lock "cinder-c7d0688f-90a0-4803-a042-0e8522b0aeb6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-quobyte-c7d0688f-90a0-4803-a042-0e8522b0aeb6" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-c7d0688f-90a0-4803-a042-0e8522b0aeb6" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:25 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e67a44-288f-4e60-8b31-e3c5415b46dd]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:25 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" returned: 0 in 0.909s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:25 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f Apr 29 09:05:25 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:25 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6 Apr 29 09:05:25 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:25 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.906s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:25 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:25 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Deleted volume successfully. Apr 29 09:05:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-84139bb3-a6a9-4d34-b7f1-8db2fc364dcb tempest-VolumesGetTest-1548789976 None] Lock "cinder-ac9c2982-fbec-4800-911c-3cece201a886-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:26 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" returned: 0 in 0.655s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-30e3f7a3-160f-4abd-826a-a4c16ce1b80f" released by "delete_volume" :: held 1.630s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Created reservations ['135bc91f-ad83-466f-bdf4-3d9cbea971dc', '448ddcdd-366a-485b-b793-3aa3322dc1b0', '6dbaa663-b422-4723-ac4c-9ff113e5874a', 'd406cd3c-ad50-4004-a76f-2f24aa6053ac'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:26 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6" returned: 0 in 0.881s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:26 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:05:26 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:26 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6 Apr 29 09:05:26 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:26 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.646s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:26 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Deleted volume successfully. Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-18e506f1-740a-4b43-9dac-eaa5c93f6071 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-30e3f7a3-160f-4abd-826a-a4c16ce1b80f-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:26 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c7d0688f-90a0-4803-a042-0e8522b0aeb6" returned: 0 in 0.745s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:26 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-c7d0688f-90a0-4803-a042-0e8522b0aeb6" released by "delete_volume" :: held 1.681s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Created reservations ['271f1cce-480c-4961-9465-382b8149c1ec', 'fda8e6f6-440d-42ba-a1c6-941aacba5c26', '5c4fae0d-a649-47d2-83b5-f6439feb0bcd', '346d29a7-78bd-426f-b47a-f6c846f36c18'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:27 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:05:27 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Flow 'volume_create_manager' (9afd8f10-e24e-46a7-a51c-35833aa74e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1191f5-d187-40ac-a2f3-63ec4d6a1853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1191f5-d187-40ac-a2f3-63ec4d6a1853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1819072926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d05c21-ce39-4d57-bc2c-2c03cae94099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e22b58be31b4643ad84f7a39e81d66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:27Z,use_quota=True,user_id='2344d611a1cf4f99b62401465074ccac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890d6433-1be2-4dfe-ad05-d9c07e9dd2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890d6433-1be2-4dfe-ad05-d9c07e9dd2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd6e3d2-4726-4999-9f8e-cb0b9978dcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd6e3d2-4726-4999-9f8e-cb0b9978dcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d05c21-ce39-4d57-bc2c-2c03cae94099', 'volume_name': 'volume-66d05c21-ce39-4d57-bc2c-2c03cae94099', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3fb660-043c-4e32-8d60-d7a48a47ba93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3fb660-043c-4e32-8d60-d7a48a47ba93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1559cca0-d12d-4d1b-8ab1-0652d1502230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:27 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Volume 66d05c21-ce39-4d57-bc2c-2c03cae94099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d05c21-ce39-4d57-bc2c-2c03cae94099', 'volume_size': 1} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1819072926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d05c21-ce39-4d57-bc2c-2c03cae94099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e22b58be31b4643ad84f7a39e81d66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:27Z,use_quota=True,user_id='2344d611a1cf4f99b62401465074ccac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Creating volume 66d05c21-ce39-4d57-bc2c-2c03cae94099 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:27 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:27 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 1073741824 Apr 29 09:05:27 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "cinder-54c9172f-72d3-43f8-99bc-00485945d9a3-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Lock "cinder-54c9172f-72d3-43f8-99bc-00485945d9a3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "cinder-quobyte-54c9172f-72d3-43f8-99bc-00485945d9a3" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Lock "cinder-quobyte-54c9172f-72d3-43f8-99bc-00485945d9a3" acquired by "delete_volume" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[384f7e0a-96f5-4bbf-8748-3a8e921be331]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-54c9172f-72d3-43f8-99bc-00485945d9a3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:27 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.700s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:27 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Deleted volume successfully. Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6bf4df64-2f8c-435a-9b66-6f1e974e0f9f tempest-VolumesGetTest-1548789976 None] Lock "cinder-c7d0688f-90a0-4803-a042-0e8522b0aeb6-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:27 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-54c9172f-72d3-43f8-99bc-00485945d9a3 Apr 29 09:05:27 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:27 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (99389c4e-175c-42fd-9bcb-7077330ffdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68dbc75-b7a7-4092-8950-fa5a8752c6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68dbc75-b7a7-4092-8950-fa5a8752c6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-240777021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265ba85d-2266-4f5e-b9a5-ff7b50d2d40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:28Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c3ce3a-d76c-489c-9e80-57ff22ccb52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c3ce3a-d76c-489c-9e80-57ff22ccb52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eba029f-b765-45e8-9b33-acc1f1fecc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eba029f-b765-45e8-9b33-acc1f1fecc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265ba85d-2266-4f5e-b9a5-ff7b50d2d40c', 'volume_name': 'volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa85c814-150b-49e4-98c1-2fe7c46a5329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa85c814-150b-49e4-98c1-2fe7c46a5329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab18d02-bbf9-494c-aa65-7fce675d9953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:28 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Volume 265ba85d-2266-4f5e-b9a5-ff7b50d2d40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c', 'volume_size': 1} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:28 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 1073741824" returned: 0 in 0.991s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:28 devstack sudo[91791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 Apr 29 09:05:28 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:28 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-54c9172f-72d3-43f8-99bc-00485945d9a3" returned: 0 in 0.753s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-54c9172f-72d3-43f8-99bc-00485945d9a3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:28 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-54c9172f-72d3-43f8-99bc-00485945d9a3 Apr 29 09:05:28 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:28 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099" returned: 0 in 0.629s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.863s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-240777021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265ba85d-2266-4f5e-b9a5-ff7b50d2d40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:28Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Creating volume 265ba85d-2266-4f5e-b9a5-ff7b50d2d40c {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:28 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:28 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c 1073741824 Apr 29 09:05:28 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1559cca0-d12d-4d1b-8ab1-0652d1502230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d05c21-ce39-4d57-bc2c-2c03cae94099', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1930f36-a8fb-4413-b15b-abff38cc0d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:29 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Volume volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 (66d05c21-ce39-4d57-bc2c-2c03cae94099): created successfully Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1930f36-a8fb-4413-b15b-abff38cc0d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Flow 'volume_create_manager' (9afd8f10-e24e-46a7-a51c-35833aa74e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:29 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-0b2219f2-b4b6-4f95-b944-af70f7313f30 tempest-VolumesSnapshotTestJSON-990983153 None] Created volume successfully. Apr 29 09:05:29 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-54c9172f-72d3-43f8-99bc-00485945d9a3" returned: 0 in 0.618s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Lock "cinder-quobyte-54c9172f-72d3-43f8-99bc-00485945d9a3" released by "delete_volume" :: held 1.440s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Created reservations ['2b76bb25-0dbb-4bfb-a430-5974bed40e04', '2c4c6e89-205a-4d64-afa2-e7e75eb5f153', '60f86e35-f736-4a99-b245-bf391754287d', '944a1be6-11ac-4751-9876-f744dc1e2b27'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:29 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:05:29 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:29 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c 1073741824" returned: 0 in 0.807s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:29 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c Apr 29 09:05:29 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "cinder-32f41668-ef22-4150-89df-28905b4d5607-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Lock "cinder-32f41668-ef22-4150-89df-28905b4d5607-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:30 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.711s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:30 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Deleted volume successfully. Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6dcdbfd9-2197-434d-9799-e539920adc2d tempest-VolumesListTestJSON-1172242369 None] Lock "cinder-54c9172f-72d3-43f8-99bc-00485945d9a3-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "cinder-quobyte-32f41668-ef22-4150-89df-28905b4d5607" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Lock "cinder-quobyte-32f41668-ef22-4150-89df-28905b4d5607" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d0ac4b-0f15-45bd-b700-108b0cae034b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-32f41668-ef22-4150-89df-28905b4d5607 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:30 devstack sudo[91811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-32f41668-ef22-4150-89df-28905b4d5607 Apr 29 09:05:30 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:30 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c" returned: 0 in 0.644s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.910s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab18d02-bbf9-494c-aa65-7fce675d9953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65b75e2-ba06-4c03-ab86-1960f6ca2a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] Creating offline snapshot 25d421cc-6113-45c2-aeac-21e83bd4ed43 of volume 66d05c21-ce39-4d57-bc2c-2c03cae94099 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:05:30 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Volume volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c (265ba85d-2266-4f5e-b9a5-ff7b50d2d40c): created successfully Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65b75e2-ba06-4c03-ab86-1960f6ca2a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (99389c4e-175c-42fd-9bcb-7077330ffdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[40775192-96d4-4718-8c6f-5401c081e08e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:30 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-68ed58ff-0fab-4d1b-8021-ee5b643206b4 tempest-VolumesGetTest-1548789976 None] Created volume successfully. Apr 29 09:05:30 devstack sudo[91815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 Apr 29 09:05:30 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:30 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-32f41668-ef22-4150-89df-28905b4d5607" returned: 0 in 0.688s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-32f41668-ef22-4150-89df-28905b4d5607 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:30 devstack sudo[91820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-32f41668-ef22-4150-89df-28905b4d5607 Apr 29 09:05:30 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:31 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099" returned: 0 in 0.764s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:31 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 1G Apr 29 09:05:31 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:31 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-32f41668-ef22-4150-89df-28905b4d5607" returned: 0 in 0.712s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Lock "cinder-quobyte-32f41668-ef22-4150-89df-28905b4d5607" released by "delete_volume" :: held 1.457s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Created reservations ['769b377f-7def-445f-b36f-08d80c85b507', 'a5f52072-6ddf-40a8-b68c-fe6b32bae147', '55825fb4-7a0c-4df4-8443-e55a19c0d48a', '337f8b9f-264a-4123-953f-17ba6a5e0ba9'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (0017863e-5dc8-4225-a958-dc84aa03d1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a767e3-d1db-431b-8b5f-2c571f4df690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:31 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:05:31 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a767e3-d1db-431b-8b5f-2c571f4df690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-429866996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88b8b20-7712-4375-887d-819c3182d13f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=265ba85d-2266-4f5e-b9a5-ff7b50d2d40c,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:32Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602a6402-dd11-4db4-ab92-aaa2999bd59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602a6402-dd11-4db4-ab92-aaa2999bd59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302a7163-ecca-4ae4-828e-055c5847f057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302a7163-ecca-4ae4-828e-055c5847f057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a88b8b20-7712-4375-887d-819c3182d13f', 'volume_name': 'volume-a88b8b20-7712-4375-887d-819c3182d13f', 'volume_size': 1, 'source_volid': '265ba85d-2266-4f5e-b9a5-ff7b50d2d40c', 'source_volstatus': 'available'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe534d5-baf1-40de-80ae-28c4e9d15c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe534d5-baf1-40de-80ae-28c4e9d15c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5bf292-bbb3-4fad-98ed-7c3cb8dba7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:31 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Volume a88b8b20-7712-4375-887d-819c3182d13f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a88b8b20-7712-4375-887d-819c3182d13f', 'volume_size': 1, 'source_volid': '265ba85d-2266-4f5e-b9a5-ff7b50d2d40c', 'source_volstatus': 'available'} Apr 29 09:05:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:32 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 1G" returned: 0 in 0.857s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:32 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 Apr 29 09:05:32 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "cinder-9d2b76c7-155f-47b8-bc0a-2c8048d8f978-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Lock "cinder-9d2b76c7-155f-47b8-bc0a-2c8048d8f978-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "cinder-quobyte-9d2b76c7-155f-47b8-bc0a-2c8048d8f978" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:32 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.666s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Lock "cinder-quobyte-9d2b76c7-155f-47b8-bc0a-2c8048d8f978" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:32 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Deleted volume successfully. Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[076cf552-7185-4279-b8c3-2e2d2eb344ac]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a134f8fb-65ce-4691-928b-c59e9189a34a tempest-VolumesListTestJSON-1172242369 None] Lock "cinder-32f41668-ef22-4150-89df-28905b4d5607-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:32 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978 Apr 29 09:05:32 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:32 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43" returned: 0 in 0.829s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:32 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 is being set with open permissions: ugo+rw Apr 29 09:05:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:32 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 Apr 29 09:05:32 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:33 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978" returned: 0 in 0.872s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:33 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978 Apr 29 09:05:33 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:33 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43" returned: 0 in 0.611s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:33 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.info Apr 29 09:05:33 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:33 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9d2b76c7-155f-47b8-bc0a-2c8048d8f978" returned: 0 in 0.613s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Lock "cinder-quobyte-9d2b76c7-155f-47b8-bc0a-2c8048d8f978" released by "delete_volume" :: held 1.540s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Created reservations ['3c83835d-4ccd-423c-8a57-566af3706284', '07a449c7-c4ab-4164-afe6-2294d80fe2d2', '8613e9d2-1a13-4bcc-bab5-8f70a6d4dc33', '55110480-13c8-49b1-8c6c-686b1513c6c7'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:34 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:05:34 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:34 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.info" returned: 0 in 0.700s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:34 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.info is being set with open permissions: ugo+rw Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:34 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.info Apr 29 09:05:34 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:34 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.619s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:34 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Deleted volume successfully. Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6da9ebde-948d-4362-ab53-43cc0c5adcac tempest-VolumesListTestJSON-1172242369 None] Lock "cinder-9d2b76c7-155f-47b8-bc0a-2c8048d8f978-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:34 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.info" returned: 0 in 0.702s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.578s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.096s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:35 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Cloning volume 265ba85d-2266-4f5e-b9a5-ff7b50d2d40c to volume a88b8b20-7712-4375-887d-819c3182d13f Apr 29 09:05:35 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-9656b9c8-5fbb-4c88-8152-c0c498ceafec tempest-VolumesSnapshotTestJSON-990983153 None] Create snapshot completed successfully Apr 29 09:05:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Creating offline snapshot bcae6338-8a92-404e-986d-e72685c10b3b of volume 265ba85d-2266-4f5e-b9a5-ff7b50d2d40c {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:05:35 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e1b51b-66e5-4547-b435-5a7d72531a30]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:35 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c Apr 29 09:05:35 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:35 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c" returned: 0 in 0.735s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:35 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b 1G Apr 29 09:05:35 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Flow 'volume_create_manager' (e044ccbb-4eb7-4d4c-ad7f-d528d4bca6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43852474-ba5d-4fc3-9dfa-5818a8a455c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43852474-ba5d-4fc3-9dfa-5818a8a455c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-155689272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859938a2-7c3d-4580-aa25-736f722639aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e22b58be31b4643ad84f7a39e81d66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=25d421cc-6113-45c2-aeac-21e83bd4ed43,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:36Z,use_quota=True,user_id='2344d611a1cf4f99b62401465074ccac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927f6ec6-8aab-4c29-a421-68273175f22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927f6ec6-8aab-4c29-a421-68273175f22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbcd068-27a7-4cf4-b846-8ba6eaf4e8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbcd068-27a7-4cf4-b846-8ba6eaf4e8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '859938a2-7c3d-4580-aa25-736f722639aa', 'volume_name': 'volume-859938a2-7c3d-4580-aa25-736f722639aa', 'volume_size': 1, 'snapshot_id': '25d421cc-6113-45c2-aeac-21e83bd4ed43'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e915841-8612-4871-b3b8-09ac3947e0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e915841-8612-4871-b3b8-09ac3947e0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8be460-e5aa-4033-b4eb-9e4829ee6b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:36 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Volume 859938a2-7c3d-4580-aa25-736f722639aa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-859938a2-7c3d-4580-aa25-736f722639aa', 'volume_size': 1, 'snapshot_id': '25d421cc-6113-45c2-aeac-21e83bd4ed43'} Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:36 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b 1G" returned: 0 in 0.968s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:36 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b Apr 29 09:05:36 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:37 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b" returned: 0 in 0.762s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:37 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b is being set with open permissions: ugo+rw Apr 29 09:05:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:37 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b Apr 29 09:05:37 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:37 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Flow 'volume_create_manager' (82561ee2-db21-4987-b3a2-6272e752150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4ad07e-b972-4da4-aac6-e05d7be76f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4ad07e-b972-4da4-aac6-e05d7be76f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-518306611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23a363b-54f2-4fca-a1ee-8e40bb8b5043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d0e63aee74c4da7194a24caeb8679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:38Z,use_quota=True,user_id='737aa46be52540ffbbf92be1e08ae871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cde96a3-da71-444c-b54b-c27650ff2953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cde96a3-da71-444c-b54b-c27650ff2953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dddb909-3962-4d3a-a8e9-e4cdacd8258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dddb909-3962-4d3a-a8e9-e4cdacd8258f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e23a363b-54f2-4fca-a1ee-8e40bb8b5043', 'volume_name': 'volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82396fed-b9c5-4221-85e9-cd37043a9c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82396fed-b9c5-4221-85e9-cd37043a9c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e339948-7b44-44ba-b0e4-249312c489d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Volume e23a363b-54f2-4fca-a1ee-8e40bb8b5043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043', 'volume_size': 1} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:38 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b" returned: 0 in 0.694s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:38 devstack sudo[91915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.info Apr 29 09:05:38 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Flow 'volume_create_manager' (aaa74b49-b6ed-4405-b9da-21200fc2df6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f5baa9-f319-4716-9014-fc1d650fe981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f5baa9-f319-4716-9014-fc1d650fe981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-881150752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab894145-247e-482b-b2b3-3b672370018c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d0e63aee74c4da7194a24caeb8679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:38Z,use_quota=True,user_id='737aa46be52540ffbbf92be1e08ae871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05cfd33-37eb-4414-8da8-84ebc03107f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05cfd33-37eb-4414-8da8-84ebc03107f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8dbca9-e677-4cfe-b902-03a8d65f0868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8dbca9-e677-4cfe-b902-03a8d65f0868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab894145-247e-482b-b2b3-3b672370018c', 'volume_name': 'volume-ab894145-247e-482b-b2b3-3b672370018c', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3eee8e1-dd0a-47d5-8b3f-447b3d453637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3eee8e1-dd0a-47d5-8b3f-447b3d453637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c6e27d-46d2-4e60-b7d5-8745d322d4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Volume ab894145-247e-482b-b2b3-3b672370018c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab894145-247e-482b-b2b3-3b672370018c', 'volume_size': 1} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Flow 'volume_create_manager' (1201a5e7-e6b4-4097-89c1-633d3f198f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a81f58b-6ea5-4007-829e-81c05eb65a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a81f58b-6ea5-4007-829e-81c05eb65a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-85371885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5762d8b-d22a-4ed3-b570-ce61a6aa4738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d0e63aee74c4da7194a24caeb8679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:39Z,use_quota=True,user_id='737aa46be52540ffbbf92be1e08ae871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f46b00-8ad7-4739-a3d3-090ebcd53eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f46b00-8ad7-4739-a3d3-090ebcd53eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980aec40-a265-4b76-8e1d-5ba8ac8d7573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980aec40-a265-4b76-8e1d-5ba8ac8d7573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5762d8b-d22a-4ed3-b570-ce61a6aa4738', 'volume_name': 'volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e36b65-c6a9-44cf-b36a-8609fae2c08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e36b65-c6a9-44cf-b36a-8609fae2c08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38de35c-9174-49d1-9298-d073733cd65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:38 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Volume a5762d8b-d22a-4ed3-b570-ce61a6aa4738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738', 'volume_size': 1} Apr 29 09:05:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:38 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.info" returned: 0 in 0.723s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:39 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.info is being set with open permissions: ugo+rw Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:39 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.info Apr 29 09:05:39 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Flow 'volume_create_manager' (3b0ff13c-5b15-4439-af72-f33a2b4dedb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10dd8d15-2bb7-4fd9-9bc7-7d86064f2326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10dd8d15-2bb7-4fd9-9bc7-7d86064f2326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-636188121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ef4005-ed3c-448e-84e5-a47a8eebc4a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d0e63aee74c4da7194a24caeb8679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:39Z,use_quota=True,user_id='737aa46be52540ffbbf92be1e08ae871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e735d61f-fc1e-4bce-ab9e-6baead453a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e735d61f-fc1e-4bce-ab9e-6baead453a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1749a0-917c-4a5a-8a15-43625e9ad585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1749a0-917c-4a5a-8a15-43625e9ad585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ef4005-ed3c-448e-84e5-a47a8eebc4a7', 'volume_name': 'volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed390e58-9ae1-49f0-9b69-cdd3b9e9eaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed390e58-9ae1-49f0-9b69-cdd3b9e9eaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a703bd14-926e-44eb-a79b-775a3ef58349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:39 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Volume e2ef4005-ed3c-448e-84e5-a47a8eebc4a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7', 'volume_size': 1} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Flow 'volume_create_manager' (4e19fd70-53cd-4b93-9947-1d869cf857e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7404d53a-3e9b-4b7f-803c-8ac2a2605d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7404d53a-3e9b-4b7f-803c-8ac2a2605d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546058490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05dc450d-a8f6-425d-ac70-c5eafa01e752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d0e63aee74c4da7194a24caeb8679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:39Z,use_quota=True,user_id='737aa46be52540ffbbf92be1e08ae871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc2b8ea-2ea7-4af5-ad87-0279f828c41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc2b8ea-2ea7-4af5-ad87-0279f828c41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca412459-c29a-4aac-969b-23bb131e4686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca412459-c29a-4aac-969b-23bb131e4686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05dc450d-a8f6-425d-ac70-c5eafa01e752', 'volume_name': 'volume-05dc450d-a8f6-425d-ac70-c5eafa01e752', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0b7fd5-7741-44b1-8906-cab4610fd004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0b7fd5-7741-44b1-8906-cab4610fd004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96614db-9dea-4190-a489-d579eec22bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:39 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Volume 05dc450d-a8f6-425d-ac70-c5eafa01e752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05dc450d-a8f6-425d-ac70-c5eafa01e752', 'volume_size': 1} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:39 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.info" returned: 0 in 0.710s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-quobyte-a88b8b20-7712-4375-887d-819c3182d13f" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-a88b8b20-7712-4375-887d-819c3182d13f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] snapshot: bcae6338-8a92-404e-986d-e72685c10b3b, volume: a88b8b20-7712-4375-887d-819c3182d13f, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56db63d-fad9-4edf-b19c-0ec25905265a]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:39 devstack sudo[91922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b Apr 29 09:05:39 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:40 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b" returned: 0 in 0.739s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:05:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:05:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:05:40 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[172499b4-b5cf-4ee7-b4fe-15e544652740]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:40 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c Apr 29 09:05:40 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:41 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c" returned: 0 in 0.760s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:41 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:05:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:41 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f Apr 29 09:05:41 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:46 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f" returned: 0 in 4.859s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:46 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b934ae-00d1-4d7b-832f-3f298dbeaac4]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:46 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c Apr 29 09:05:46 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:47 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c" returned: 0 in 0.927s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:47 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:05:47 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Converted 1024.00 MB image at 210.68 MB/s Apr 29 09:05:47 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f is being set with open permissions: ugo+rw Apr 29 09:05:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:47 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f Apr 29 09:05:47 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:47 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f" returned: 0 in 0.612s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-a88b8b20-7712-4375-887d-819c3182d13f" released by "_copy_volume_from_snapshot" :: held 7.977s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-quobyte-bcae6338-8a92-404e-986d-e72685c10b3b" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-bcae6338-8a92-404e-986d-e72685c10b3b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Deleting offline snapshot bcae6338-8a92-404e-986d-e72685c10b3b of volume 265ba85d-2266-4f5e-b9a5-ff7b50d2d40c {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:05:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] snapshot_file for this snap is: volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:05:47 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d224dd-e47e-41dc-ac0b-232947f04650]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:47 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b Apr 29 09:05:47 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:48 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b" returned: 0 in 0.823s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:48 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:05:48 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[32eb93ff-bd4a-4c9d-9da4-c9a38070aabb]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:48 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c Apr 29 09:05:48 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:49 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c" returned: 0 in 0.767s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:49 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b Apr 29 09:05:49 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:49 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=60,cinder:INSERT=19,cinder:UPDATE=67,cinder:DELETE=6 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:05:50 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b" returned: 0 in 0.750s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:50 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b Apr 29 09:05:50 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:50 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c.bcae6338-8a92-404e-986d-e72685c10b3b" returned: 0 in 0.612s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-bcae6338-8a92-404e-986d-e72685c10b3b" released by "_delete_snapshot" :: held 3.038s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.818s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 14.125s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-25d421cc-6113-45c2-aeac-21e83bd4ed43-859938a2-7c3d-4580-aa25-736f722639aa" by "_create_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5bf292-bbb3-4fad-98ed-7c3cb8dba7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88b8b20-7712-4375-887d-819c3182d13f', 'volume_size': 1, 'source_volid': '265ba85d-2266-4f5e-b9a5-ff7b50d2d40c', 'source_volstatus': 'available'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbf12a7-f8c0-45fa-9f08-0b1021fcebb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-25d421cc-6113-45c2-aeac-21e83bd4ed43-859938a2-7c3d-4580-aa25-736f722639aa" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Creating volume 859938a2-7c3d-4580-aa25-736f722639aa from snapshot 25d421cc-6113-45c2-aeac-21e83bd4ed43 {{(pid=83712) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-859938a2-7c3d-4580-aa25-736f722639aa" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:50 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Volume volume-a88b8b20-7712-4375-887d-819c3182d13f (a88b8b20-7712-4375-887d-819c3182d13f): created successfully Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbf12a7-f8c0-45fa-9f08-0b1021fcebb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (0017863e-5dc8-4225-a958-dc84aa03d1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-859938a2-7c3d-4580-aa25-736f722639aa" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] snapshot: 25d421cc-6113-45c2-aeac-21e83bd4ed43, volume: 859938a2-7c3d-4580-aa25-736f722639aa, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:50 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-31393d02-a201-422a-b1b3-1250b093a5c2 tempest-VolumesGetTest-1548789976 None] Created volume successfully. Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad03e4f-d106-4b24-9087-9e932c48ed16]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:51 devstack sudo[91979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 Apr 29 09:05:51 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:51 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43" returned: 0 in 0.755s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:51 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66d05c21-ce39-4d57-bc2c-2c03cae94099(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:05:51 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:05:51 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:05:51 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ae4c99-364e-4c3c-b132-04ce84c71477]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:51 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 Apr 29 09:05:51 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (2a3c982f-e16b-460c-a7d6-da5cb5eb98ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bb6bf8-ac12-4aa8-b3be-346a7ddc2ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bb6bf8-ac12-4aa8-b3be-346a7ddc2ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1055174103',display_name='tempest-VolumesGetTest-Volume-60467963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb60c33-9fd7-46fc-b227-353a0c536afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:52Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed705640-e5af-4509-882d-ed5353be8f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed705640-e5af-4509-882d-ed5353be8f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6734d31-3f40-4d93-ad96-fc70ba09a42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6734d31-3f40-4d93-ad96-fc70ba09a42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb60c33-9fd7-46fc-b227-353a0c536afd', 'volume_name': 'volume-8fb60c33-9fd7-46fc-b227-353a0c536afd', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8848b14-48a0-477d-a801-813a1662e220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8848b14-48a0-477d-a801-813a1662e220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83c1534-1ca0-454a-bc43-99f591db432e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:52 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Volume 8fb60c33-9fd7-46fc-b227-353a0c536afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb60c33-9fd7-46fc-b227-353a0c536afd', 'volume_size': 1} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:52 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099" returned: 0 in 0.741s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:05:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:52 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa Apr 29 09:05:52 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:57 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa" returned: 0 in 4.831s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:57 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8a02c3-7452-4309-bba4-72a041771197]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:57 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 Apr 29 09:05:57 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:58 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099" returned: 0 in 0.948s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:05:58 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Converted 1024.00 MB image at 211.93 MB/s Apr 29 09:05:58 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa is being set with open permissions: ugo+rw Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:58 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa Apr 29 09:05:58 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:58 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa" returned: 0 in 0.581s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-859938a2-7c3d-4580-aa25-736f722639aa" released by "_copy_volume_from_snapshot" :: held 7.971s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-25d421cc-6113-45c2-aeac-21e83bd4ed43-859938a2-7c3d-4580-aa25-736f722639aa" released by "_create_volume_from_snapshot" :: held 8.014s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.059s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.834s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-518306611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23a363b-54f2-4fca-a1ee-8e40bb8b5043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d0e63aee74c4da7194a24caeb8679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:38Z,use_quota=True,user_id='737aa46be52540ffbbf92be1e08ae871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Creating volume e23a363b-54f2-4fca-a1ee-8e40bb8b5043 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:58 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:58 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043 1073741824 Apr 29 09:05:58 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8be460-e5aa-4033-b4eb-9e4829ee6b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859938a2-7c3d-4580-aa25-736f722639aa', 'volume_size': 1, 'snapshot_id': '25d421cc-6113-45c2-aeac-21e83bd4ed43'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71d861e-93b8-4989-a9a0-eb5b999c00c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:58 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Volume volume-859938a2-7c3d-4580-aa25-736f722639aa (859938a2-7c3d-4580-aa25-736f722639aa): created successfully Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71d861e-93b8-4989-a9a0-eb5b999c00c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Flow 'volume_create_manager' (e044ccbb-4eb7-4d4c-ad7f-d528d4bca6b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:58 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-83ca716a-035b-432f-8c6b-926baf63dc22 tempest-VolumesSnapshotTestJSON-990983153 None] Created volume successfully. Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-859938a2-7c3d-4580-aa25-736f722639aa-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-859938a2-7c3d-4580-aa25-736f722639aa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-859938a2-7c3d-4580-aa25-736f722639aa" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:59 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:05:59 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-859938a2-7c3d-4580-aa25-736f722639aa" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[47364c56-15a0-4d7e-9c82-a6117599b339]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:59 devstack sudo[92022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa Apr 29 09:05:59 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:59 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043 1073741824" returned: 0 in 0.976s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:59 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043 Apr 29 09:05:59 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:00 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.662s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:00 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa" returned: 0 in 0.768s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:00 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa Apr 29 09:06:00 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:00 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043" returned: 0 in 0.744s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.202s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-881150752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab894145-247e-482b-b2b3-3b672370018c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d0e63aee74c4da7194a24caeb8679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:38Z,use_quota=True,user_id='737aa46be52540ffbbf92be1e08ae871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Creating volume ab894145-247e-482b-b2b3-3b672370018c {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:00 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ab894145-247e-482b-b2b3-3b672370018c 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:00 devstack sudo[92033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ab894145-247e-482b-b2b3-3b672370018c 1073741824 Apr 29 09:06:00 devstack sudo[92033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e339948-7b44-44ba-b0e4-249312c489d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61c956d-6fcd-4071-bbae-e54e6f29a174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:00 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Volume volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043 (e23a363b-54f2-4fca-a1ee-8e40bb8b5043): created successfully Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61c956d-6fcd-4071-bbae-e54e6f29a174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:00 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Flow 'volume_create_manager' (82561ee2-db21-4987-b3a2-6272e752150f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:00 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b8469c8a-add0-4d46-80e1-6075863a1d68 tempest-CreateVolumesFromImageTest-689055182 None] Created volume successfully. Apr 29 09:06:01 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-859938a2-7c3d-4580-aa25-736f722639aa" returned: 0 in 0.628s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-859938a2-7c3d-4580-aa25-736f722639aa" released by "delete_volume" :: held 1.451s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Created reservations ['599faf11-50bc-4580-84f7-b3a9710ace94', 'ea8c7fe0-7ca1-4fce-a066-af37e91ccf3c', '28321752-a74b-4798-b805-387f7cdfbcc8', '3836bd14-4790-4d56-9683-52e34427b26d'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:01 devstack sudo[92036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:01 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:01 devstack sudo[92033]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ab894145-247e-482b-b2b3-3b672370018c 1073741824" returned: 0 in 0.933s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ab894145-247e-482b-b2b3-3b672370018c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:01 devstack sudo[92042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ab894145-247e-482b-b2b3-3b672370018c Apr 29 09:06:01 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:01 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.621s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:01 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Deleted volume successfully. Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-25d421cc-6113-45c2-aeac-21e83bd4ed43-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8dcf2cd1-e784-42b5-9fae-909fd70cd58d tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-859938a2-7c3d-4580-aa25-736f722639aa-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-25d421cc-6113-45c2-aeac-21e83bd4ed43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-66d05c21-ce39-4d57-bc2c-2c03cae94099" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-66d05c21-ce39-4d57-bc2c-2c03cae94099" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-25d421cc-6113-45c2-aeac-21e83bd4ed43" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-25d421cc-6113-45c2-aeac-21e83bd4ed43" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Deleting offline snapshot 25d421cc-6113-45c2-aeac-21e83bd4ed43 of volume 66d05c21-ce39-4d57-bc2c-2c03cae94099 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] snapshot_file for this snap is: volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d92dd9-9447-4283-a5ec-3876ee22fd21]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:02 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 Apr 29 09:06:02 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:02 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ab894145-247e-482b-b2b3-3b672370018c" returned: 0 in 0.750s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.554s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-85371885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5762d8b-d22a-4ed3-b570-ce61a6aa4738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d0e63aee74c4da7194a24caeb8679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:39Z,use_quota=True,user_id='737aa46be52540ffbbf92be1e08ae871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Creating volume a5762d8b-d22a-4ed3-b570-ce61a6aa4738 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:02 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c6e27d-46d2-4e60-b7d5-8745d322d4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab894145-247e-482b-b2b3-3b672370018c', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c60c13-0591-4c2c-843f-728057962714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:02 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738 1073741824 Apr 29 09:06:02 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:02 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Volume volume-ab894145-247e-482b-b2b3-3b672370018c (ab894145-247e-482b-b2b3-3b672370018c): created successfully Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c60c13-0591-4c2c-843f-728057962714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Flow 'volume_create_manager' (aaa74b49-b6ed-4405-b9da-21200fc2df6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:02 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a4e1454e-c1cf-4166-9564-d8cc833b65a4 tempest-CreateVolumesFromImageTest-689055182 None] Created volume successfully. Apr 29 09:06:02 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43" returned: 0 in 0.720s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66d05c21-ce39-4d57-bc2c-2c03cae94099(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b787f27-390b-4c27-b345-0e71f8cae45b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:02 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 Apr 29 09:06:02 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:03 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738 1073741824" returned: 0 in 0.921s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:03 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099" returned: 0 in 0.741s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:03 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738 Apr 29 09:06:03 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:03 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 Apr 29 09:06:03 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:04 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738" returned: 0 in 0.673s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.830s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-636188121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ef4005-ed3c-448e-84e5-a47a8eebc4a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d0e63aee74c4da7194a24caeb8679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:39Z,use_quota=True,user_id='737aa46be52540ffbbf92be1e08ae871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Creating volume e2ef4005-ed3c-448e-84e5-a47a8eebc4a7 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:04 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:04 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7 1073741824 Apr 29 09:06:04 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38de35c-9174-49d1-9298-d073733cd65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8500b2-236e-42cb-b2f5-44044710af34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:04 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Volume volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738 (a5762d8b-d22a-4ed3-b570-ce61a6aa4738): created successfully Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8500b2-236e-42cb-b2f5-44044710af34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:04 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Flow 'volume_create_manager' (1201a5e7-e6b4-4097-89c1-633d3f198f30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43" returned: 0 in 0.757s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:04 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-19f360ea-7c2c-42f6-9005-b816d7762beb tempest-CreateVolumesFromImageTest-689055182 None] Created volume successfully. Apr 29 09:06:04 devstack sudo[92070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43 Apr 29 09:06:04 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:04 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099.25d421cc-6113-45c2-aeac-21e83bd4ed43" returned: 0 in 0.720s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-25d421cc-6113-45c2-aeac-21e83bd4ed43" released by "_delete_snapshot" :: held 3.048s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-66d05c21-ce39-4d57-bc2c-2c03cae94099" released by "delete_snapshot" :: held 3.077s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Created reservations ['71384868-c87f-45f5-880e-1efb0f1b2eb0', 'ff09d413-11c2-4b58-b704-001e70abd16e', '08d0cf7b-94ca-4a40-b740-45ad82dfb129', 'cf8e1867-1d7d-478c-8a05-8435e39ff6ae'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:05 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:05 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Delete snapshot completed successfully. Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7 1073741824" returned: 0 in 0.982s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-33d905ce-f9d1-4351-9641-af3d751563b0 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-25d421cc-6113-45c2-aeac-21e83bd4ed43-delete_snapshot" released by "delete_snapshot" :: held 3.235s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:05 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7 Apr 29 09:06:05 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:05 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7" returned: 0 in 0.666s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.245s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546058490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05dc450d-a8f6-425d-ac70-c5eafa01e752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d0e63aee74c4da7194a24caeb8679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:39Z,use_quota=True,user_id='737aa46be52540ffbbf92be1e08ae871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Creating volume 05dc450d-a8f6-425d-ac70-c5eafa01e752 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:05 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-05dc450d-a8f6-425d-ac70-c5eafa01e752 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:05 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-05dc450d-a8f6-425d-ac70-c5eafa01e752 1073741824 Apr 29 09:06:05 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a703bd14-926e-44eb-a79b-775a3ef58349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa6bf96-3660-4b71-a6f6-817a8fd9c14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:05 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Volume volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7 (e2ef4005-ed3c-448e-84e5-a47a8eebc4a7): created successfully Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa6bf96-3660-4b71-a6f6-817a8fd9c14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Flow 'volume_create_manager' (3b0ff13c-5b15-4439-af72-f33a2b4dedb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:05 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e89d8c54-f3c8-4e9c-a84b-552ac73aa627 tempest-CreateVolumesFromImageTest-689055182 None] Created volume successfully. Apr 29 09:06:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-66d05c21-ce39-4d57-bc2c-2c03cae94099-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-66d05c21-ce39-4d57-bc2c-2c03cae94099-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-66d05c21-ce39-4d57-bc2c-2c03cae94099" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-66d05c21-ce39-4d57-bc2c-2c03cae94099" acquired by "delete_volume" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:06 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74a5850-183b-49ef-bc56-b9c062a0877c]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:06 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 Apr 29 09:06:06 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:06 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-05dc450d-a8f6-425d-ac70-c5eafa01e752 1073741824" returned: 0 in 0.837s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-05dc450d-a8f6-425d-ac70-c5eafa01e752 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:06 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-05dc450d-a8f6-425d-ac70-c5eafa01e752 Apr 29 09:06:06 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:07 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099" returned: 0 in 0.812s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:07 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099 Apr 29 09:06:07 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:07 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-05dc450d-a8f6-425d-ac70-c5eafa01e752" returned: 0 in 0.657s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.203s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1055174103',display_name='tempest-VolumesGetTest-Volume-60467963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb60c33-9fd7-46fc-b227-353a0c536afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:52Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Creating volume 8fb60c33-9fd7-46fc-b227-353a0c536afd {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:07 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8fb60c33-9fd7-46fc-b227-353a0c536afd 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96614db-9dea-4190-a489-d579eec22bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05dc450d-a8f6-425d-ac70-c5eafa01e752', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d35c9c-58d9-430d-88bf-6e25549a10b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:07 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8fb60c33-9fd7-46fc-b227-353a0c536afd 1073741824 Apr 29 09:06:07 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:07 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Volume volume-05dc450d-a8f6-425d-ac70-c5eafa01e752 (05dc450d-a8f6-425d-ac70-c5eafa01e752): created successfully Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d35c9c-58d9-430d-88bf-6e25549a10b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Flow 'volume_create_manager' (4e19fd70-53cd-4b93-9947-1d869cf857e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:07 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-4c6b3670-af60-4dec-9e33-cde00eda56c3 tempest-CreateVolumesFromImageTest-689055182 None] Created volume successfully. Apr 29 09:06:07 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-66d05c21-ce39-4d57-bc2c-2c03cae94099" returned: 0 in 0.620s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-66d05c21-ce39-4d57-bc2c-2c03cae94099" released by "delete_volume" :: held 1.494s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Created reservations ['746c8225-79ad-4b2f-a481-51edc37fb4dc', '99cbd7ba-0ecd-46ef-985b-972aa5646213', 'dbf24c80-d61a-464a-afe2-57263a875af8', 'f0454b6f-eb96-4b50-9558-572701375eb8'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:07 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:07 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "cinder-05dc450d-a8f6-425d-ac70-c5eafa01e752-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-05dc450d-a8f6-425d-ac70-c5eafa01e752-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "cinder-quobyte-05dc450d-a8f6-425d-ac70-c5eafa01e752" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-quobyte-05dc450d-a8f6-425d-ac70-c5eafa01e752" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:08 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8fb60c33-9fd7-46fc-b227-353a0c536afd 1073741824" returned: 0 in 0.922s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6398955-3463-4fe9-a3c1-3a8214245af8]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-05dc450d-a8f6-425d-ac70-c5eafa01e752 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8fb60c33-9fd7-46fc-b227-353a0c536afd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:08 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8fb60c33-9fd7-46fc-b227-353a0c536afd Apr 29 09:06:08 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:08 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-05dc450d-a8f6-425d-ac70-c5eafa01e752 Apr 29 09:06:08 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-e0d583fc-5c36-471f-aade-fcd89f1fb80d-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:08 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.681s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-e0d583fc-5c36-471f-aade-fcd89f1fb80d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:08 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Deleted volume successfully. Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-12722bac-4ec2-4a35-b728-66f652d8c06d tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-66d05c21-ce39-4d57-bc2c-2c03cae94099-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "cinder-quobyte-e0d583fc-5c36-471f-aade-fcd89f1fb80d" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-e0d583fc-5c36-471f-aade-fcd89f1fb80d" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf64b7a0-57e8-41c0-8f4b-05f7e73085a9]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:08 devstack sudo[92109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d Apr 29 09:06:08 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:09 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8fb60c33-9fd7-46fc-b227-353a0c536afd" returned: 0 in 0.683s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83c1534-1ca0-454a-bc43-99f591db432e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb60c33-9fd7-46fc-b227-353a0c536afd', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b252083-e0db-41dd-8453-f80c0087c7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:09 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Volume volume-8fb60c33-9fd7-46fc-b227-353a0c536afd (8fb60c33-9fd7-46fc-b227-353a0c536afd): created successfully Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b252083-e0db-41dd-8453-f80c0087c7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (2a3c982f-e16b-460c-a7d6-da5cb5eb98ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:09 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-3f7af17c-0298-4a27-8463-647fd782f2a3 tempest-VolumesGetTest-1548789976 None] Created volume successfully. Apr 29 09:06:09 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-05dc450d-a8f6-425d-ac70-c5eafa01e752" returned: 0 in 0.970s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-05dc450d-a8f6-425d-ac70-c5eafa01e752 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:09 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-05dc450d-a8f6-425d-ac70-c5eafa01e752 Apr 29 09:06:09 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-8fb60c33-9fd7-46fc-b227-353a0c536afd-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:09 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d" returned: 0 in 0.785s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Lock "cinder-8fb60c33-9fd7-46fc-b227-353a0c536afd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:09 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d Apr 29 09:06:09 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-quobyte-8fb60c33-9fd7-46fc-b227-353a0c536afd" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-8fb60c33-9fd7-46fc-b227-353a0c536afd" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01a2536-ca90-4c81-b2b7-824eee99cf9d]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8fb60c33-9fd7-46fc-b227-353a0c536afd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:09 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8fb60c33-9fd7-46fc-b227-353a0c536afd Apr 29 09:06:09 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:09 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-05dc450d-a8f6-425d-ac70-c5eafa01e752" returned: 0 in 0.658s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-quobyte-05dc450d-a8f6-425d-ac70-c5eafa01e752" released by "delete_volume" :: held 1.681s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:09 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Created reservations ['f685e9d8-ad05-41a7-982d-0c8eb45585ea', 'b32488aa-6956-46ba-9813-070398f9ee7f', 'bbfff571-b18a-4240-b030-57b5340e3651', '2700f1dc-a7cb-4b94-86a5-873770496cd4'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:10 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:10 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:10 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0d583fc-5c36-471f-aade-fcd89f1fb80d" returned: 0 in 0.709s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-quobyte-e0d583fc-5c36-471f-aade-fcd89f1fb80d" released by "delete_volume" :: held 1.561s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Created reservations ['1820abf0-77e1-4230-b48d-351bd675c1b5', '3181f7a8-5dce-4c02-ab2c-c1917382307b', 'b71183b2-8347-4ce1-bb3c-d0938b71ccf8', '8889d841-2526-49e2-a679-44a2d00f20a3'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:10 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:10 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:10 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8fb60c33-9fd7-46fc-b227-353a0c536afd" returned: 0 in 0.842s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8fb60c33-9fd7-46fc-b227-353a0c536afd {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "cinder-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:10 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8fb60c33-9fd7-46fc-b227-353a0c536afd Apr 29 09:06:10 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "cinder-quobyte-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-quobyte-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a4002-1e59-4cf5-9b28-19b76b4629c1]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:10 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7 Apr 29 09:06:10 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:10 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.870s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:10 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Deleted volume successfully. Apr 29 09:06:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f4268b74-1dc2-4a23-8870-c5e1e3632fc0 tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-05dc450d-a8f6-425d-ac70-c5eafa01e752-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:11 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.736s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:11 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Deleted volume successfully. Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-36f950f5-33b2-4224-b2bc-10f9b0ebd9a8 tempest-VolumesSnapshotTestJSON-990983153 None] Lock "cinder-e0d583fc-5c36-471f-aade-fcd89f1fb80d-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:11 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8fb60c33-9fd7-46fc-b227-353a0c536afd" returned: 0 in 0.754s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-8fb60c33-9fd7-46fc-b227-353a0c536afd" released by "delete_volume" :: held 1.642s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Created reservations ['076a5dff-4712-41ed-8d4d-d4382d2901ef', '4aa72f6b-e7e4-401c-b98d-6a4d1827fdcb', '2c1863ab-5d11-403a-958f-d00a0d8568fc', '51c463e5-5c28-46a2-8e05-e25bec1d7a5d'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:11 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:11 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:11 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7" returned: 0 in 0.868s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:11 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7 Apr 29 09:06:11 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-a88b8b20-7712-4375-887d-819c3182d13f-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Lock "cinder-a88b8b20-7712-4375-887d-819c3182d13f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-quobyte-a88b8b20-7712-4375-887d-819c3182d13f" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-a88b8b20-7712-4375-887d-819c3182d13f" acquired by "delete_volume" :: waited 0.029s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[21453ec6-5d64-4788-b193-35257692b160]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:12 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.806s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:12 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Deleted volume successfully. Apr 29 09:06:12 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f Apr 29 09:06:12 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e29eee9b-6ee6-4ac2-aca5-f9dcda5e3d44 tempest-VolumesGetTest-1548789976 None] Lock "cinder-8fb60c33-9fd7-46fc-b227-353a0c536afd-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:12 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7" returned: 0 in 0.835s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-quobyte-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7" released by "delete_volume" :: held 1.783s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Created reservations ['2fa057aa-5c36-458a-be0b-8aec09df3292', 'ef3fd9b0-d203-4b7d-9b9b-72634112f459', '92c34118-5027-4473-9b51-e0415dace83f', 'f77e445a-8f8d-4f08-8f2d-bb5cdbb5555b'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:12 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:12 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "cinder-a5762d8b-d22a-4ed3-b570-ce61a6aa4738-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-a5762d8b-d22a-4ed3-b570-ce61a6aa4738-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:12 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f" returned: 0 in 0.846s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:12 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f Apr 29 09:06:12 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "cinder-quobyte-a5762d8b-d22a-4ed3-b570-ce61a6aa4738" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-quobyte-a5762d8b-d22a-4ed3-b570-ce61a6aa4738" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb041acf-2f6c-4707-b975-b73ffc9f78b7]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:13 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738 Apr 29 09:06:13 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:13 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.737s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:13 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Deleted volume successfully. Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6dfb16e2-ddc6-4c30-b931-064fbfd4a4b6 tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-e2ef4005-ed3c-448e-84e5-a47a8eebc4a7-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:13 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a88b8b20-7712-4375-887d-819c3182d13f" returned: 0 in 0.687s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-a88b8b20-7712-4375-887d-819c3182d13f" released by "delete_volume" :: held 1.589s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Created reservations ['89edd06b-c138-45a2-bcca-369f1cac3f57', '0b818499-ccb6-4dc5-b13a-1054183a5db9', '99a59e8d-33cb-4980-ac30-7fec0512f601', '84c4b18d-4d57-44a4-862f-5ef441bb6cf5'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:13 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:13 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:13 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738" returned: 0 in 0.813s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:13 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738 Apr 29 09:06:13 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Lock "cinder-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-quobyte-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c" acquired by "delete_volume" :: waited 0.040s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcad582a-38bf-41bf-a959-670c8151dfa6]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:14 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c Apr 29 09:06:14 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:14 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a5762d8b-d22a-4ed3-b570-ce61a6aa4738" returned: 0 in 0.871s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:14 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.960s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:14 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Deleted volume successfully. Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-quobyte-a5762d8b-d22a-4ed3-b570-ce61a6aa4738" released by "delete_volume" :: held 1.746s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0333a129-e4a7-4e5b-b039-563cca720757 tempest-VolumesGetTest-1548789976 None] Lock "cinder-a88b8b20-7712-4375-887d-819c3182d13f-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Created reservations ['bbb46f60-9765-46ab-a33b-0f5884305707', 'f3fd0a5e-bdf1-4f2f-9cfe-83a1d01b88bf', '070621f4-89fa-41e7-ab25-ece4f9fb6ce4', 'a1840ab6-8c16-48da-b29f-3aaf4278b24b'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:14 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:14 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "cinder-ab894145-247e-482b-b2b3-3b672370018c-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-ab894145-247e-482b-b2b3-3b672370018c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "cinder-quobyte-ab894145-247e-482b-b2b3-3b672370018c" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-quobyte-ab894145-247e-482b-b2b3-3b672370018c" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:15 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[23577566-7ae0-4751-a446-2bf4e52e3981]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ab894145-247e-482b-b2b3-3b672370018c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:15 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c" returned: 0 in 0.917s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:15 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ab894145-247e-482b-b2b3-3b672370018c Apr 29 09:06:15 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:15 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c Apr 29 09:06:15 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:15 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.900s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:15 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:15 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Deleted volume successfully. Apr 29 09:06:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-71efcb0b-a770-4c5e-8e17-cabcce9e894b tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-a5762d8b-d22a-4ed3-b570-ce61a6aa4738-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:16 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c" returned: 0 in 0.736s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c" released by "delete_volume" :: held 1.747s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:16 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ab894145-247e-482b-b2b3-3b672370018c" returned: 0 in 0.909s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ab894145-247e-482b-b2b3-3b672370018c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:16 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ab894145-247e-482b-b2b3-3b672370018c Apr 29 09:06:16 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:16 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Created reservations ['e52022f1-dfd0-4f8d-bcbf-2e8650522950', '5f986896-d561-4f77-820f-2a4b5f161d3c', '9f5ea0f3-c4ac-481f-aa73-c25431d2a66b', '8a6e86df-2000-409f-b385-ca2d38d5ba39'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:16 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:16 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:16 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:16 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:17 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ab894145-247e-482b-b2b3-3b672370018c" returned: 0 in 0.829s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:17 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-quobyte-ab894145-247e-482b-b2b3-3b672370018c" released by "delete_volume" :: held 1.793s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.679s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:17 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Deleted volume successfully. Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-31bd7e3b-435a-4463-9677-1885b9333837 tempest-VolumesGetTest-1548789976 None] Lock "cinder-265ba85d-2266-4f5e-b9a5-ff7b50d2d40c-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Created reservations ['94ec3a75-bf07-4a73-9a5d-8d70129b4909', '7538d995-fa74-4717-a943-b85f984f7e7a', 'c7929fd9-e4f9-470a-9c48-c20358dbc352', '4ac3527f-ffb4-459a-8e36-efb93174f307'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:17 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:17 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "cinder-e23a363b-54f2-4fca-a1ee-8e40bb8b5043-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-e23a363b-54f2-4fca-a1ee-8e40bb8b5043-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "cinder-quobyte-e23a363b-54f2-4fca-a1ee-8e40bb8b5043" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-quobyte-e23a363b-54f2-4fca-a1ee-8e40bb8b5043" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3ad4f0-1df0-483a-af2a-3578beca2ed5]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:17 devstack sudo[92200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043 Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:06:17 devstack sudo[92200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (0c96ee22-2cea-419a-8269-26d38d43101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df45921-beb4-4a63-98aa-688cca519f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df45921-beb4-4a63-98aa-688cca519f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-928644692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2643ca-e116-4172-b15b-403c4a3257d7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:18Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ee6323-6339-4e0d-a229-2b73604d5669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ee6323-6339-4e0d-a229-2b73604d5669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f89d2af-8cdf-4e02-a6c0-28a31a1d9a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:17 devstack cinder-volume[83712]: DEBUG cinder.image.glance [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Creating Keystone auth plugin from conf {{(pid=83712) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 09:06:18 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.776s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:18 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Deleted volume successfully. Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b4c564b7-37e1-4548-bc08-2fe0346e1b4d tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-ab894145-247e-482b-b2b3-3b672370018c-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f89d2af-8cdf-4e02-a6c0-28a31a1d9a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da2643ca-e116-4172-b15b-403c4a3257d7', 'volume_name': 'volume-da2643ca-e116-4172-b15b-403c4a3257d7', 'volume_size': 1, 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '858a6a572bfe4bfbb235aa79c8ac3e8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'created_at': datetime.datetime(2026, 4, 29, 6, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4f018c-4e6c-444d-9b4f-3036b29c18ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4f018c-4e6c-444d-9b4f-3036b29c18ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2b633c-23c5-40e1-9ca7-53e84f924706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:18 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Volume da2643ca-e116-4172-b15b-403c4a3257d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da2643ca-e116-4172-b15b-403c4a3257d7', 'volume_size': 1, 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '858a6a572bfe4bfbb235aa79c8ac3e8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'created_at': datetime.datetime(2026, 4, 29, 6, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Trying to clone da2643ca-e116-4172-b15b-403c4a3257d7 from image 34fc92fe-7bdb-4c18-872f-7ff972aac86b at location (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]). {{(pid=83712) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Flow 'volume_create_manager' (2997a6da-7d60-4961-8fe0-027ec2c8ea67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bb26c5-f225-421a-b771-be586077bdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:18 devstack sudo[92200]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043" returned: 0 in 0.979s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:18 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043 Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bb26c5-f225-421a-b771-be586077bdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-334325403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3703b8de-070c-46c7-b8d8-719c8c9c563d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e536fbf826e4f1c9271da782a9d3a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:18Z,use_quota=True,user_id='0cd0b8232d4745bbaeaa2a92da7123c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:18 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d796fdc-9aae-4ea0-ba85-81547d54a223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d796fdc-9aae-4ea0-ba85-81547d54a223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e395d61-f673-4d5d-bc33-651391b6553d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e395d61-f673-4d5d-bc33-651391b6553d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3703b8de-070c-46c7-b8d8-719c8c9c563d', 'volume_name': 'volume-3703b8de-070c-46c7-b8d8-719c8c9c563d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c058eb3-bc19-45d6-83f0-4a06cb168db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c058eb3-bc19-45d6-83f0-4a06cb168db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3367cc-b8a2-40de-88f0-e0385fe88195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:18 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Volume 3703b8de-070c-46c7-b8d8-719c8c9c563d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3703b8de-070c-46c7-b8d8-719c8c9c563d', 'volume_size': 1} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-334325403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3703b8de-070c-46c7-b8d8-719c8c9c563d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e536fbf826e4f1c9271da782a9d3a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:18Z,use_quota=True,user_id='0cd0b8232d4745bbaeaa2a92da7123c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Creating volume 3703b8de-070c-46c7-b8d8-719c8c9c563d {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:18 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:18 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d 1073741824 Apr 29 09:06:18 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83712) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 09:06:18 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Image download 20.69 MB at 20.69 MB/s Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[d124248b-4ff6-4b5b-bd23-ba26aa2ee429]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:18 devstack sudo[92212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD Apr 29 09:06:18 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:19 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e23a363b-54f2-4fca-a1ee-8e40bb8b5043" returned: 0 in 0.787s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-quobyte-e23a363b-54f2-4fca-a1ee-8e40bb8b5043" released by "delete_volume" :: held 1.824s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Created reservations ['51de6b6d-6f4d-4e5d-9026-71434c7c9718', '2667a079-3e16-454d-8e93-b4ed49912c6b', 'c92352a1-147b-42c1-87c8-3fde53b4f99b', '95bb1edf-2510-40d9-bd09-4a90a5141ebd'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:19 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d 1073741824" returned: 0 in 0.854s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:19 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD" returned: 0 in 0.793s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Temporary image 34fc92fe-7bdb-4c18-872f-7ff972aac86b is fetched for user 91337f5ca8574e11a7b081936b33fd54. {{(pid=83712) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 09:06:19 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:19 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:19 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d Apr 29 09:06:19 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b7e599-973c-4bd0-94f5-be6b9599d37b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:19 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD Apr 29 09:06:19 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:20 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d" returned: 0 in 0.705s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3367cc-b8a2-40de-88f0-e0385fe88195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3703b8de-070c-46c7-b8d8-719c8c9c563d', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d30f25-408e-4d5e-a6bb-c23c90cc897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:20 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Volume volume-3703b8de-070c-46c7-b8d8-719c8c9c563d (3703b8de-070c-46c7-b8d8-719c8c9c563d): created successfully Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d30f25-408e-4d5e-a6bb-c23c90cc897b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Flow 'volume_create_manager' (2997a6da-7d60-4961-8fe0-027ec2c8ea67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:20 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8c712ae8-005a-48ab-bfb1-40a321a7eae2 tempest-VolumesSnapshotListTestJSON-1800639634 None] Created volume successfully. Apr 29 09:06:20 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.827s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:20 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Deleted volume successfully. Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-6a6381d2-4caa-4c4f-99d6-365d5637e891 tempest-CreateVolumesFromImageTest-689055182 None] Lock "cinder-e23a363b-54f2-4fca-a1ee-8e40bb8b5043-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:20 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD" returned: 0 in 0.810s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-928644692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2643ca-e116-4172-b15b-403c4a3257d7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:18Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Creating volume da2643ca-e116-4172-b15b-403c4a3257d7 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:20 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:20 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 1073741824 Apr 29 09:06:20 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:21 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 1073741824" returned: 0 in 1.017s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:21 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 Apr 29 09:06:21 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:22 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7" returned: 0 in 0.669s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.316s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] Creating offline snapshot db80e363-6147-4343-b706-10148dfa057b of volume 3703b8de-070c-46c7-b8d8-719c8c9c563d {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:06:22 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:UPDATE=193,cinder:SELECT=118,cinder:INSERT=48,cinder:DELETE=18 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:06:22 devstack cinder-volume[83712]: DEBUG cinder.volume.volume_utils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Attempting download of 34fc92fe-7bdb-4c18-872f-7ff972aac86b ((None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}])) to volume da2643ca-e116-4172-b15b-403c4a3257d7. {{(pid=83712) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 09:06:22 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[6455e87e-ff66-4ff5-8634-347ab813dd3a]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:22 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[762ac7e1-2022-403d-a7f4-e7f9f8e43c0c]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_a7g3w4dh {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:22 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d Apr 29 09:06:22 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:22 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_a7g3w4dh Apr 29 09:06:22 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Flow 'volume_create_manager' (67b54860-9ade-474f-9d44-2e434c1fdb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261da4ce-a442-4f96-9a94-6fb63e57d99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261da4ce-a442-4f96-9a94-6fb63e57d99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567833517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d3fda3-6770-4711-bd1a-ae58b21fcbc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c6eb5386d4afa812140935d8dfd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:23Z,use_quota=True,user_id='a4fe00e3f75f4c5e9ec71d07d42f7690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2774d3f-c8d1-4adb-a99b-ce3f5e29d9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2774d3f-c8d1-4adb-a99b-ce3f5e29d9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:23 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef842f5-e4a4-4bb6-a999-7750d31b7e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef842f5-e4a4-4bb6-a999-7750d31b7e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d3fda3-6770-4711-bd1a-ae58b21fcbc9', 'volume_name': 'volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50256b77-f1f7-4eb6-98fb-c657b2be2da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50256b77-f1f7-4eb6-98fb-c657b2be2da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949162de-5c3d-4461-b8e0-06f68ea5ac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:23 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume 96d3fda3-6770-4711-bd1a-ae58b21fcbc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9', 'volume_size': 1} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d" returned: 0 in 0.881s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:23 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_a7g3w4dh" returned: 0 in 0.834s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_a7g3w4dh {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:23 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b 1G Apr 29 09:06:23 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:23 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_a7g3w4dh Apr 29 09:06:23 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:23 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_a7g3w4dh" returned: 1 in 0.733s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34fc92fe-7bdb-4c18-872f-7ff972aac86b_a7g3w4dh' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5524c5-8956-4de7-833b-8c80253a8ac5]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:23 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b 1G" returned: 0 in 0.785s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3703b8de-070c-46c7-b8d8-719c8c9c563d -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:23 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3703b8de-070c-46c7-b8d8-719c8c9c563d -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b Apr 29 09:06:23 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:23 devstack sudo[92264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD Apr 29 09:06:23 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:24 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3703b8de-070c-46c7-b8d8-719c8c9c563d -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b" returned: 0 in 0.645s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:24 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b is being set with open permissions: ugo+rw Apr 29 09:06:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:24 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b Apr 29 09:06:24 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:24 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:24 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] 34fc92fe-7bdb-4c18-872f-7ff972aac86b was qcow2, converting to raw {{(pid=83712) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 09:06:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:24 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 Apr 29 09:06:24 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:25 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b" returned: 0 in 0.633s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:25 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.info Apr 29 09:06:25 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:25 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.info" returned: 0 in 0.647s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:25 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.info is being set with open permissions: ugo+rw Apr 29 09:06:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:25 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.info Apr 29 09:06:25 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:26 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7" returned: 0 in 1.911s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_34fc92fe-7bdb-4c18-872f-7ff972aac86b_xz4baewadevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:06:26 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Converted 112.00 MB image at 58.57 MB/s Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:26 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 1G Apr 29 09:06:26 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:26 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.info" returned: 0 in 0.743s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.441s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.518s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567833517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d3fda3-6770-4711-bd1a-ae58b21fcbc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c6eb5386d4afa812140935d8dfd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:23Z,use_quota=True,user_id='a4fe00e3f75f4c5e9ec71d07d42f7690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Creating volume 96d3fda3-6770-4711-bd1a-ae58b21fcbc9 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:26 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:26 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9 1073741824 Apr 29 09:06:26 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:26 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-5d02d22b-8056-489f-8eb3-c7a0dca3da54 tempest-VolumesSnapshotListTestJSON-1800639634 None] Create snapshot completed successfully Apr 29 09:06:27 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 1G" returned: 0 in 0.648s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:27 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f091a8-23ad-49f0-8785-aa1e1a8502a6]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:27 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 Apr 29 09:06:27 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:27 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9 1073741824" returned: 0 in 0.950s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:27 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9 Apr 29 09:06:27 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:27 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7" returned: 0 in 0.734s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:28 devstack sudo[92311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 Apr 29 09:06:28 devstack sudo[92311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:28 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9" returned: 0 in 0.718s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.960s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949162de-5c3d-4461-b8e0-06f68ea5ac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6616ff59-badf-4f66-a5fc-dfde85f02f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] Creating offline snapshot b0476337-1179-4483-87d5-eacdc1e4215d of volume 3703b8de-070c-46c7-b8d8-719c8c9c563d {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:06:28 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9 (96d3fda3-6770-4711-bd1a-ae58b21fcbc9): created successfully Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6616ff59-badf-4f66-a5fc-dfde85f02f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Flow 'volume_create_manager' (67b54860-9ade-474f-9d44-2e434c1fdb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3230d2-899c-450b-99e2-c1df505f298e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:28 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-824cf99a-2f59-4291-a64b-fbbaf2221246 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Created volume successfully. Apr 29 09:06:28 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b Apr 29 09:06:28 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:28 devstack sudo[92311]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7" returned: 1 in 0.722s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.volume_utils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Downloaded image 34fc92fe-7bdb-4c18-872f-7ff972aac86b ((None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}])) to volume da2643ca-e116-4172-b15b-403c4a3257d7 successfully. {{(pid=83712) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Temporary image 34fc92fe-7bdb-4c18-872f-7ff972aac86b for user 91337f5ca8574e11a7b081936b33fd54 is deleted. {{(pid=83712) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.volume_utils [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Marking volume da2643ca-e116-4172-b15b-403c4a3257d7 as bootable. {{(pid=83712) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Copying metadata from image 34fc92fe-7bdb-4c18-872f-7ff972aac86b to da2643ca-e116-4172-b15b-403c4a3257d7. {{(pid=83712) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Creating volume glance metadata for volume da2643ca-e116-4172-b15b-403c4a3257d7 backed by image 34fc92fe-7bdb-4c18-872f-7ff972aac86b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83712) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2b633c-23c5-40e1-9ca7-53e84f924706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da2643ca-e116-4172-b15b-403c4a3257d7', 'volume_size': 1, 'image_id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '858a6a572bfe4bfbb235aa79c8ac3e8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '34fc92fe-7bdb-4c18-872f-7ff972aac86b', 'created_at': datetime.datetime(2026, 4, 29, 6, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34fc92fe-7bdb-4c18-872f-7ff972aac86b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00ed680-d5f0-44ea-95ea-26d5074ba06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:28 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Volume volume-da2643ca-e116-4172-b15b-403c4a3257d7 (da2643ca-e116-4172-b15b-403c4a3257d7): created successfully Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00ed680-d5f0-44ea-95ea-26d5074ba06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (0c96ee22-2cea-419a-8269-26d38d43101a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:28 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-bed01324-f277-42db-b228-a769ccecc797 tempest-VolumesGetTest-1548789976 None] Created volume successfully. Apr 29 09:06:29 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b" returned: 0 in 0.729s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:29 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3703b8de-070c-46c7-b8d8-719c8c9c563d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:06:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:29 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d 1G Apr 29 09:06:29 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:29 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:06:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Flow 'volume_create_manager' (48a1b767-9aef-4679-a5d9-a5cff7157992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b9bb3e-8756-427d-8252-401406fa9356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b9bb3e-8756-427d-8252-401406fa9356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1011568618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1773e71b-54ef-4ed8-85e9-6ef5799977a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c6eb5386d4afa812140935d8dfd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:30Z,use_quota=True,user_id='a4fe00e3f75f4c5e9ec71d07d42f7690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa53c0a0-5753-48d4-9e29-06fd39e147e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa53c0a0-5753-48d4-9e29-06fd39e147e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefd11fd-3c97-4aad-913b-01fa8995f93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefd11fd-3c97-4aad-913b-01fa8995f93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1773e71b-54ef-4ed8-85e9-6ef5799977a8', 'volume_name': 'volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:29 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117287e3-58c0-4da9-9179-dc4133f25ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117287e3-58c0-4da9-9179-dc4133f25ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03210614-3d98-44d3-a6ea-162c54bd803a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume 1773e71b-54ef-4ed8-85e9-6ef5799977a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8', 'volume_size': 1} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:30 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d 1G" returned: 0 in 0.933s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:30 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d Apr 29 09:06:30 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (a8aac0be-8360-4d64-9b4e-7decb5b48004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48102b2a-c97b-4877-ade1-27466065e2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48102b2a-c97b-4877-ade1-27466065e2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-444920328',display_name='tempest-VolumesGetTest-Volume-1611045503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2bc752-b5a0-4d37-8e09-3d6d2406ac51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:30Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ddd297-12a1-43ce-ac39-8684cfee800b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ddd297-12a1-43ce-ac39-8684cfee800b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0519001-a65d-4fec-9505-a0393a167ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0519001-a65d-4fec-9505-a0393a167ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2bc752-b5a0-4d37-8e09-3d6d2406ac51', 'volume_name': 'volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbfcdfb-b8f3-47c1-af5c-e4d85bbf5547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbfcdfb-b8f3-47c1-af5c-e4d85bbf5547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770da32f-0d2a-427c-a59c-cd5d3dbf69ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Volume fb2bc752-b5a0-4d37-8e09-3d6d2406ac51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51', 'volume_size': 1} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Flow 'volume_create_manager' (218b219d-da75-46ba-bd67-5ba714d44c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716935d1-dbed-44c6-a1c5-ed2929eeed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716935d1-dbed-44c6-a1c5-ed2929eeed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573479647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4e81c2-7377-4b07-962f-6966c2d77d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c6eb5386d4afa812140935d8dfd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:30Z,use_quota=True,user_id='a4fe00e3f75f4c5e9ec71d07d42f7690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbb0304-8184-424b-ae6a-d98f18e579a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbb0304-8184-424b-ae6a-d98f18e579a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (753f9186-c7f8-49c8-b8f7-13e783d57b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (753f9186-c7f8-49c8-b8f7-13e783d57b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f4e81c2-7377-4b07-962f-6966c2d77d95', 'volume_name': 'volume-3f4e81c2-7377-4b07-962f-6966c2d77d95', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b84fbcb-7323-4e3d-a358-bcc5d7c9e612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b84fbcb-7323-4e3d-a358-bcc5d7c9e612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b4cb1d-08ef-4387-b7f2-c7513f105ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume 3f4e81c2-7377-4b07-962f-6966c2d77d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f4e81c2-7377-4b07-962f-6966c2d77d95', 'volume_size': 1} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Flow 'volume_create_manager' (e598372a-7296-43f3-b0f8-294f72aa50d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04572267-5680-4b5e-9225-e42032cb6d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04572267-5680-4b5e-9225-e42032cb6d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-407623472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2343bca0-1df4-497a-9937-36310e5537c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c6eb5386d4afa812140935d8dfd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:31Z,use_quota=True,user_id='a4fe00e3f75f4c5e9ec71d07d42f7690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d475b1-f7ca-42f1-b8e8-9a6e36041fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d475b1-f7ca-42f1-b8e8-9a6e36041fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fc808e-986a-4b52-b844-54929f7fafb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fc808e-986a-4b52-b844-54929f7fafb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2343bca0-1df4-497a-9937-36310e5537c2', 'volume_name': 'volume-2343bca0-1df4-497a-9937-36310e5537c2', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279721f2-56db-458a-8ad2-1200d3bd0f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279721f2-56db-458a-8ad2-1200d3bd0f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a37860e-570c-468d-985f-2250ae769599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:30 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume 2343bca0-1df4-497a-9937-36310e5537c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2343bca0-1df4-497a-9937-36310e5537c2', 'volume_size': 1} Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:30 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d" returned: 0 in 0.806s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:30 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d is being set with open permissions: ugo+rw Apr 29 09:06:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:31 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d Apr 29 09:06:31 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Flow 'volume_create_manager' (ad1aa336-83e0-4499-9252-d4af18cdf7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024e233a-df6d-4f64-871f-4745c2e5ad6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024e233a-df6d-4f64-871f-4745c2e5ad6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-956243954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb32caa-91e3-47ae-80a9-e969cbda70f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c6eb5386d4afa812140935d8dfd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:31Z,use_quota=True,user_id='a4fe00e3f75f4c5e9ec71d07d42f7690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b95f120-0eb0-43a2-8aa0-1c704a469875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b95f120-0eb0-43a2-8aa0-1c704a469875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44181a6-f672-41bd-9b4d-7132fdb8795a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44181a6-f672-41bd-9b4d-7132fdb8795a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eb32caa-91e3-47ae-80a9-e969cbda70f7', 'volume_name': 'volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0f61c3-14e2-4bd5-804e-c6f3ac8a7af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0f61c3-14e2-4bd5-804e-c6f3ac8a7af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26e89c5-0306-4ef3-9326-cd051c29cf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:31 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume 2eb32caa-91e3-47ae-80a9-e969cbda70f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7', 'volume_size': 1} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Flow 'volume_create_manager' (63e6fce4-6eae-404a-9dd2-16c605129018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6079c700-e511-44f1-baa7-fa0c1d66cc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6079c700-e511-44f1-baa7-fa0c1d66cc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-820582598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f409d8-e435-420f-821c-fb6e9459afd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c6eb5386d4afa812140935d8dfd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:31Z,use_quota=True,user_id='a4fe00e3f75f4c5e9ec71d07d42f7690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c2c69c-0bdf-4ead-bdd6-e2eb55c430b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c2c69c-0bdf-4ead-bdd6-e2eb55c430b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2da12ff-7247-4c0b-8eeb-9a6787231e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2da12ff-7247-4c0b-8eeb-9a6787231e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f409d8-e435-420f-821c-fb6e9459afd9', 'volume_name': 'volume-c5f409d8-e435-420f-821c-fb6e9459afd9', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ffec38-4f59-418c-ae92-8bc44b9a9380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ffec38-4f59-418c-ae92-8bc44b9a9380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f353c5-0c11-4bd1-a5a6-84dcf94bd94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:31 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume c5f409d8-e435-420f-821c-fb6e9459afd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f409d8-e435-420f-821c-fb6e9459afd9', 'volume_size': 1} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:31 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d" returned: 0 in 0.652s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.266s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.648s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1011568618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1773e71b-54ef-4ed8-85e9-6ef5799977a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c6eb5386d4afa812140935d8dfd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:30Z,use_quota=True,user_id='a4fe00e3f75f4c5e9ec71d07d42f7690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Creating volume 1773e71b-54ef-4ed8-85e9-6ef5799977a8 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:31 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:31 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8 1073741824 Apr 29 09:06:31 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:31 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f2e0eae3-e342-4064-ada5-5e328a3dd348 tempest-VolumesSnapshotListTestJSON-1800639634 None] Create snapshot completed successfully Apr 29 09:06:32 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8 1073741824" returned: 0 in 0.783s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:32 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8 Apr 29 09:06:32 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:33 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8" returned: 0 in 0.643s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.650s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-444920328',display_name='tempest-VolumesGetTest-Volume-1611045503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2bc752-b5a0-4d37-8e09-3d6d2406ac51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e76f65f08cc438599a22a9a8d338de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:30Z,use_quota=True,user_id='91337f5ca8574e11a7b081936b33fd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Creating volume fb2bc752-b5a0-4d37-8e09-3d6d2406ac51 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:33 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03210614-3d98-44d3-a6ea-162c54bd803a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:33 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51 1073741824 Apr 29 09:06:33 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90bcb352-f3ed-41d4-8055-9317571f22e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:33 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8 (1773e71b-54ef-4ed8-85e9-6ef5799977a8): created successfully Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90bcb352-f3ed-41d4-8055-9317571f22e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Flow 'volume_create_manager' (48a1b767-9aef-4679-a5d9-a5cff7157992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:33 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-089a1cec-3d15-473a-932d-aacb82cfe15a tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Created volume successfully. Apr 29 09:06:33 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51 1073741824" returned: 0 in 0.772s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:33 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51 Apr 29 09:06:33 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:34 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51" returned: 0 in 0.601s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.960s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573479647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4e81c2-7377-4b07-962f-6966c2d77d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c6eb5386d4afa812140935d8dfd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:30Z,use_quota=True,user_id='a4fe00e3f75f4c5e9ec71d07d42f7690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Creating volume 3f4e81c2-7377-4b07-962f-6966c2d77d95 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:34 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3f4e81c2-7377-4b07-962f-6966c2d77d95 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:34 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3f4e81c2-7377-4b07-962f-6966c2d77d95 1073741824 Apr 29 09:06:34 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770da32f-0d2a-427c-a59c-cd5d3dbf69ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc004662-6c4b-4c0c-adcc-419b9c4186a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:34 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Volume volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51 (fb2bc752-b5a0-4d37-8e09-3d6d2406ac51): created successfully Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc004662-6c4b-4c0c-adcc-419b9c4186a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:34 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Flow 'volume_create_manager' (a8aac0be-8360-4d64-9b4e-7decb5b48004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:34 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-397d4a6a-f3f4-465d-95c5-ad9503c86a59 tempest-VolumesGetTest-1548789976 None] Created volume successfully. Apr 29 09:06:35 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3f4e81c2-7377-4b07-962f-6966c2d77d95 1073741824" returned: 0 in 0.787s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3f4e81c2-7377-4b07-962f-6966c2d77d95 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:35 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3f4e81c2-7377-4b07-962f-6966c2d77d95 Apr 29 09:06:35 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Lock "cinder-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-quobyte-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3d288d-1690-4a77-ba14-510b95af1688]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:35 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3f4e81c2-7377-4b07-962f-6966c2d77d95" returned: 0 in 0.612s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.185s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-407623472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2343bca0-1df4-497a-9937-36310e5537c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c6eb5386d4afa812140935d8dfd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:31Z,use_quota=True,user_id='a4fe00e3f75f4c5e9ec71d07d42f7690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Creating volume 2343bca0-1df4-497a-9937-36310e5537c2 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:36 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2343bca0-1df4-497a-9937-36310e5537c2 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:36 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51 Apr 29 09:06:36 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:36 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2343bca0-1df4-497a-9937-36310e5537c2 1073741824 Apr 29 09:06:36 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b4cb1d-08ef-4387-b7f2-c7513f105ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4e81c2-7377-4b07-962f-6966c2d77d95', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c58aac-6059-4f0b-a66d-0828bf05f146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:36 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume volume-3f4e81c2-7377-4b07-962f-6966c2d77d95 (3f4e81c2-7377-4b07-962f-6966c2d77d95): created successfully Apr 29 09:06:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c58aac-6059-4f0b-a66d-0828bf05f146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Flow 'volume_create_manager' (218b219d-da75-46ba-bd67-5ba714d44c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:36 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6c9a1d3b-a725-4a13-9e8a-e002499a7d48 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Created volume successfully. Apr 29 09:06:36 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51" returned: 0 in 0.855s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:36 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51 Apr 29 09:06:36 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:36 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2343bca0-1df4-497a-9937-36310e5537c2 1073741824" returned: 0 in 0.839s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2343bca0-1df4-497a-9937-36310e5537c2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:36 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2343bca0-1df4-497a-9937-36310e5537c2 Apr 29 09:06:36 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:37 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51" returned: 0 in 0.640s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51" released by "delete_volume" :: held 1.560s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Created reservations ['2c88d559-694e-4c5e-9b4a-65d9d78f9c2d', '3fbe1be7-d8fa-447b-a2d1-bfa111e09041', '3a99d8a9-5748-4a56-b1fe-70d8e94ef737', 'a5488a6d-0f86-44a1-9d9a-27f934383420'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:37 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2343bca0-1df4-497a-9937-36310e5537c2" returned: 0 in 0.660s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.354s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-956243954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb32caa-91e3-47ae-80a9-e969cbda70f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c6eb5386d4afa812140935d8dfd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:31Z,use_quota=True,user_id='a4fe00e3f75f4c5e9ec71d07d42f7690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Creating volume 2eb32caa-91e3-47ae-80a9-e969cbda70f7 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:37 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:37 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:37 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:37 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7 1073741824 Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a37860e-570c-468d-985f-2250ae769599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2343bca0-1df4-497a-9937-36310e5537c2', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:37 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fbac70-7b06-4ea9-82f6-2acd3825e6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:37 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume volume-2343bca0-1df4-497a-9937-36310e5537c2 (2343bca0-1df4-497a-9937-36310e5537c2): created successfully Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fbac70-7b06-4ea9-82f6-2acd3825e6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Flow 'volume_create_manager' (e598372a-7296-43f3-b0f8-294f72aa50d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:37 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e505cc77-8aed-4deb-b000-0c1a7d572d92 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Created volume successfully. Apr 29 09:06:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-da2643ca-e116-4172-b15b-403c4a3257d7-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Lock "cinder-da2643ca-e116-4172-b15b-403c4a3257d7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Acquiring lock "cinder-quobyte-da2643ca-e116-4172-b15b-403c4a3257d7" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-da2643ca-e116-4172-b15b-403c4a3257d7" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:38 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.634s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:38 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:38 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Deleted volume successfully. Apr 29 09:06:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-56769a0e-2436-4d7f-8341-4f685305e010 tempest-VolumesGetTest-1548789976 None] Lock "cinder-fb2bc752-b5a0-4d37-8e09-3d6d2406ac51-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:38 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[a554f510-6d2e-4a94-b73d-6a55359b9526]: (4, 'raw') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:38 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 Apr 29 09:06:38 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:38 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7 1073741824" returned: 0 in 0.922s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:38 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7 Apr 29 09:06:38 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:39 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7" returned: 0 in 0.854s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:39 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7" returned: 0 in 0.639s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.695s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-820582598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f409d8-e435-420f-821c-fb6e9459afd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c6eb5386d4afa812140935d8dfd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:31Z,use_quota=True,user_id='a4fe00e3f75f4c5e9ec71d07d42f7690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Creating volume c5f409d8-e435-420f-821c-fb6e9459afd9 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:39 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 Apr 29 09:06:39 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:39 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c5f409d8-e435-420f-821c-fb6e9459afd9 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:39 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c5f409d8-e435-420f-821c-fb6e9459afd9 1073741824 Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26e89c5-0306-4ef3-9326-cd051c29cf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:39 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54c30f0-18f8-4383-bbe9-ec1e48498d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:39 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7 (2eb32caa-91e3-47ae-80a9-e969cbda70f7): created successfully Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54c30f0-18f8-4383-bbe9-ec1e48498d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Flow 'volume_create_manager' (ad1aa336-83e0-4499-9252-d4af18cdf7bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:39 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-9f0012d7-ebd2-4d53-87b4-d5d3224de56c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Created volume successfully. Apr 29 09:06:39 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7" returned: 1 in 0.746s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7' failed. Not Retrying. {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:06:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:39 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7 Apr 29 09:06:39 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:40 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c5f409d8-e435-420f-821c-fb6e9459afd9 1073741824" returned: 0 in 0.854s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c5f409d8-e435-420f-821c-fb6e9459afd9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:40 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c5f409d8-e435-420f-821c-fb6e9459afd9 Apr 29 09:06:40 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:40 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-da2643ca-e116-4172-b15b-403c4a3257d7" returned: 0 in 0.716s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Lock "cinder-quobyte-da2643ca-e116-4172-b15b-403c4a3257d7" released by "delete_volume" :: held 2.393s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Created reservations ['634912f3-277a-4d96-8bf1-f15f44da4912', 'cd6e1567-68e9-438a-aac2-5c507455c678', '81716707-0823-48fa-8c47-83c61d9aa64a', '1dc936e3-75f9-4bba-8464-f12ccc796158'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:40 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:40 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:40 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c5f409d8-e435-420f-821c-fb6e9459afd9" returned: 0 in 0.609s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.911s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f353c5-0c11-4bd1-a5a6-84dcf94bd94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f409d8-e435-420f-821c-fb6e9459afd9', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff98e79-6735-49ca-bada-448e70cc0f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] Creating offline snapshot 25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 of volume 3703b8de-070c-46c7-b8d8-719c8c9c563d {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:06:40 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Volume volume-c5f409d8-e435-420f-821c-fb6e9459afd9 (c5f409d8-e435-420f-821c-fb6e9459afd9): created successfully Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff98e79-6735-49ca-bada-448e70cc0f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Flow 'volume_create_manager' (63e6fce4-6eae-404a-9dd2-16c605129018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74d18c1-e1cb-43f7-b5e9-7056ad9f0330]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:40 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c3c48b0a-f403-43c7-bea4-04d7540175da tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Created volume successfully. Apr 29 09:06:40 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d Apr 29 09:06:40 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "cinder-c5f409d8-e435-420f-821c-fb6e9459afd9-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-c5f409d8-e435-420f-821c-fb6e9459afd9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:41 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.684s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:41 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:41 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Deleted volume successfully. Apr 29 09:06:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "cinder-quobyte-c5f409d8-e435-420f-821c-fb6e9459afd9" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-17a9015e-0cce-42cf-acf9-7ed88713f8f4 tempest-VolumesGetTest-1548789976 None] Lock "cinder-da2643ca-e116-4172-b15b-403c4a3257d7-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-quobyte-c5f409d8-e435-420f-821c-fb6e9459afd9" acquired by "delete_volume" :: waited 0.028s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:41 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d93949-bf19-4a3f-8577-436494433f92]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c5f409d8-e435-420f-821c-fb6e9459afd9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:41 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d" returned: 0 in 0.778s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3703b8de-070c-46c7-b8d8-719c8c9c563d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:06:41 devstack sudo[92457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c5f409d8-e435-420f-821c-fb6e9459afd9 Apr 29 09:06:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:41 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:41 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 1G Apr 29 09:06:41 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:42 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c5f409d8-e435-420f-821c-fb6e9459afd9" returned: 0 in 0.786s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c5f409d8-e435-420f-821c-fb6e9459afd9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:42 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c5f409d8-e435-420f-821c-fb6e9459afd9 Apr 29 09:06:42 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:42 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 1G" returned: 0 in 0.888s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:42 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 Apr 29 09:06:42 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:42 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c5f409d8-e435-420f-821c-fb6e9459afd9" returned: 0 in 0.694s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:42 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-quobyte-c5f409d8-e435-420f-821c-fb6e9459afd9" released by "delete_volume" :: held 1.533s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Created reservations ['d7f8e80a-6cab-4e00-8803-96e635017781', 'f9e729d4-b3ce-4014-a101-2f777589c682', '3fdc7e80-3a56-415b-93a8-a7033b007a41', 'aa5cf4fa-9b74-42eb-9897-0ff957a7d799'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:43 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:43 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:43 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9" returned: 0 in 0.712s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:43 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 is being set with open permissions: ugo+rw Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:43 devstack sudo[92478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 Apr 29 09:06:43 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "cinder-2eb32caa-91e3-47ae-80a9-e969cbda70f7-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-2eb32caa-91e3-47ae-80a9-e969cbda70f7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "cinder-quobyte-2eb32caa-91e3-47ae-80a9-e969cbda70f7" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-quobyte-2eb32caa-91e3-47ae-80a9-e969cbda70f7" acquired by "delete_volume" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff836d7e-0bb7-49c3-9293-248361585b9c]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:43 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.703s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:43 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Deleted volume successfully. Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-51002d2d-5a85-4cae-b677-7e42a3f01608 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-c5f409d8-e435-420f-821c-fb6e9459afd9-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:43 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9" returned: 0 in 0.675s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.190s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:43 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-cce47727-84c9-4cff-b37e-d826b1eb06a8 tempest-VolumesSnapshotListTestJSON-1800639634 None] Create snapshot completed successfully Apr 29 09:06:43 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7 Apr 29 09:06:43 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:44 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7" returned: 0 in 0.966s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:44 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7 Apr 29 09:06:44 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:44 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:06:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Flow 'volume_create_manager' (ddce2801-8934-470a-8db0-b60e59e26d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca3ced7-853a-4290-99da-4dc96a30a701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca3ced7-853a-4290-99da-4dc96a30a701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1336918508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c74845-7671-43d7-90ca-ef935ab12b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1efa4a30147df9ebb784a4ef1af26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:45Z,use_quota=True,user_id='06f8ca928a864b13987c706081965bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8727994-e6ea-4d39-96cf-4bf8a943d158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8727994-e6ea-4d39-96cf-4bf8a943d158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0336b7b5-1195-462b-8e12-a5c605ede6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0336b7b5-1195-462b-8e12-a5c605ede6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58c74845-7671-43d7-90ca-ef935ab12b6c', 'volume_name': 'volume-58c74845-7671-43d7-90ca-ef935ab12b6c', 'volume_size': 2}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf005a11-8cbd-48e9-b1a1-31f0fd69ac7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf005a11-8cbd-48e9-b1a1-31f0fd69ac7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e91b387-3558-45a1-b815-6a0ff4cb5346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:45 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Volume 58c74845-7671-43d7-90ca-ef935ab12b6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58c74845-7671-43d7-90ca-ef935ab12b6c', 'volume_size': 2} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1336918508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c74845-7671-43d7-90ca-ef935ab12b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1efa4a30147df9ebb784a4ef1af26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:45Z,use_quota=True,user_id='06f8ca928a864b13987c706081965bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Creating volume 58c74845-7671-43d7-90ca-ef935ab12b6c {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:45 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c 2147483648 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:45 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c 2147483648 Apr 29 09:06:45 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "cinder-25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "cinder-quobyte-3703b8de-070c-46c7-b8d8-719c8c9c563d" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-3703b8de-070c-46c7-b8d8-719c8c9c563d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "cinder-quobyte-25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Deleting offline snapshot 25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 of volume 3703b8de-070c-46c7-b8d8-719c8c9c563d {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] snapshot_file for this snap is: volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a86a764-a7f1-46c9-8779-253574a71743]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:45 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 Apr 29 09:06:45 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:45 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2eb32caa-91e3-47ae-80a9-e969cbda70f7" returned: 0 in 0.727s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-quobyte-2eb32caa-91e3-47ae-80a9-e969cbda70f7" released by "delete_volume" :: held 1.750s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Created reservations ['f2035c96-1e32-4182-b790-59ca923c72da', '7ca068f0-b9ce-4fa4-a406-7f0bfb50e78d', 'f9b209e7-18dd-49e3-bc4d-bbf2256ab89f', '5adc193c-4898-4f74-95a3-a6135f3797b3'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:45 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:45 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "cinder-2343bca0-1df4-497a-9937-36310e5537c2-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-2343bca0-1df4-497a-9937-36310e5537c2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "cinder-quobyte-2343bca0-1df4-497a-9937-36310e5537c2" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-quobyte-2343bca0-1df4-497a-9937-36310e5537c2" acquired by "delete_volume" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77cfff4-1899-4eef-ba2b-5f897e23b120]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2343bca0-1df4-497a-9937-36310e5537c2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:46 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c 2147483648" returned: 0 in 1.085s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:46 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9" returned: 0 in 0.830s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3703b8de-070c-46c7-b8d8-719c8c9c563d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:46 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2343bca0-1df4-497a-9937-36310e5537c2 Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c6ab38-5f80-4a9e-89f3-06d4a7581ee4]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:46 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:46 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c Apr 29 09:06:46 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:46 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d Apr 29 09:06:46 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:46 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.792s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:46 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Deleted volume successfully. Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d1cc8c3d-b621-462c-a2ee-8acb25fb1ce8 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-2eb32caa-91e3-47ae-80a9-e969cbda70f7-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:46 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2343bca0-1df4-497a-9937-36310e5537c2" returned: 0 in 0.748s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2343bca0-1df4-497a-9937-36310e5537c2 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:46 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2343bca0-1df4-497a-9937-36310e5537c2 Apr 29 09:06:46 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:46 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c" returned: 0 in 0.705s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e91b387-3558-45a1-b815-6a0ff4cb5346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c74845-7671-43d7-90ca-ef935ab12b6c', 'volume_size': 2}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b415c7ff-d988-4f64-8f0c-f65c2cb2413d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:46 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Volume volume-58c74845-7671-43d7-90ca-ef935ab12b6c (58c74845-7671-43d7-90ca-ef935ab12b6c): created successfully Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b415c7ff-d988-4f64-8f0c-f65c2cb2413d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Flow 'volume_create_manager' (ddce2801-8934-470a-8db0-b60e59e26d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:46 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:46 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-7aa4e0eb-7440-4a07-94cd-0fa7b9a381de tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Created volume successfully. Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d" returned: 0 in 0.774s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3703b8de-070c-46c7-b8d8-719c8c9c563d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:06:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:47 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 Apr 29 09:06:47 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Creating offline snapshot c38a2b23-9b5a-4c25-9802-016d87d68a84 of volume 58c74845-7671-43d7-90ca-ef935ab12b6c {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[234d0b0f-5a5f-47c3-a096-adb665d53b0b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:47 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c Apr 29 09:06:47 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:47 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2343bca0-1df4-497a-9937-36310e5537c2" returned: 0 in 0.644s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-quobyte-2343bca0-1df4-497a-9937-36310e5537c2" released by "delete_volume" :: held 1.439s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Created reservations ['7fc63d87-2aa0-4bd9-8fe0-b301345f0187', '28190ef4-bc1a-4c64-a6d1-1024d1866e83', '40205eee-2de7-47f0-95a1-331bc07edc52', 'd0710be3-b746-4671-8e77-044dc759315c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:47 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:47 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:47 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9" returned: 0 in 0.818s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:47 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:47 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9 Apr 29 09:06:47 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:48 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c" returned: 0 in 0.751s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 2G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:48 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 2G Apr 29 09:06:48 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "cinder-3f4e81c2-7377-4b07-962f-6966c2d77d95-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-3f4e81c2-7377-4b07-962f-6966c2d77d95-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:48 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.679s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:48 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Deleted volume successfully. Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "cinder-quobyte-3f4e81c2-7377-4b07-962f-6966c2d77d95" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-quobyte-3f4e81c2-7377-4b07-962f-6966c2d77d95" acquired by "delete_volume" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f19de2b6-317a-44fc-9a95-28c739fdb29f tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-2343bca0-1df4-497a-9937-36310e5537c2-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[746172eb-8c2a-464e-b2a0-011255dfe189]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3f4e81c2-7377-4b07-962f-6966c2d77d95 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:48 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3f4e81c2-7377-4b07-962f-6966c2d77d95 Apr 29 09:06:48 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:48 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9" returned: 0 in 0.733s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9" released by "_delete_snapshot" :: held 3.251s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-3703b8de-070c-46c7-b8d8-719c8c9c563d" released by "delete_snapshot" :: held 3.274s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Created reservations ['72e8de38-4bdb-4e0e-9ad5-1c6801c97182', '01951b53-307c-4e0c-8fe6-20a14268b0b2', '682ec9cd-2a98-4754-a3e6-433fff0a954c', '64156609-8377-4036-b2c3-0c82b0a93235'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:48 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Delete snapshot completed successfully. Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-dd6a79fe-2069-4693-bf14-ed49706a0163 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-25cfaa3b-1e9a-49d4-b5f7-1fd08fdc18b9-delete_snapshot" released by "delete_snapshot" :: held 3.409s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:48 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 2G" returned: 0 in 0.841s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c74845-7671-43d7-90ca-ef935ab12b6c -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:48 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c74845-7671-43d7-90ca-ef935ab12b6c -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 Apr 29 09:06:48 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:49 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3f4e81c2-7377-4b07-962f-6966c2d77d95" returned: 0 in 0.794s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3f4e81c2-7377-4b07-962f-6966c2d77d95 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:49 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3f4e81c2-7377-4b07-962f-6966c2d77d95 Apr 29 09:06:49 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "cinder-b0476337-1179-4483-87d5-eacdc1e4215d-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-b0476337-1179-4483-87d5-eacdc1e4215d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "cinder-quobyte-3703b8de-070c-46c7-b8d8-719c8c9c563d" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-3703b8de-070c-46c7-b8d8-719c8c9c563d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "cinder-quobyte-b0476337-1179-4483-87d5-eacdc1e4215d" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-b0476337-1179-4483-87d5-eacdc1e4215d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Deleting offline snapshot b0476337-1179-4483-87d5-eacdc1e4215d of volume 3703b8de-070c-46c7-b8d8-719c8c9c563d {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:06:49 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] snapshot_file for this snap is: volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c74845-7671-43d7-90ca-ef935ab12b6c -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84" returned: 0 in 0.713s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:49 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 is being set with open permissions: ugo+rw Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a7d7d3-e1cc-4306-84e2-29e85ab7ff5a]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:49 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 Apr 29 09:06:49 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:49 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d Apr 29 09:06:49 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:49 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3f4e81c2-7377-4b07-962f-6966c2d77d95" returned: 0 in 0.632s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-quobyte-3f4e81c2-7377-4b07-962f-6966c2d77d95" released by "delete_volume" :: held 1.487s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:UPDATE=199,cinder:SELECT=144,cinder:INSERT=44,cinder:DELETE=17 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Created reservations ['490f926d-9216-4c54-b91b-4b424acb57cb', '6abe7679-c63e-4525-831e-17cba3a90b6c', '3c564f7c-9cad-440b-b399-6275ccd31a0c', '06d263a6-d6b6-415d-b4ae-bd93b273eaa0'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:49 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:49 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:50 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d" returned: 0 in 0.745s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3703b8de-070c-46c7-b8d8-719c8c9c563d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:06:50 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84" returned: 0 in 0.788s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[557b0b22-f148-4058-a872-a4ab76680090]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:50 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.info Apr 29 09:06:50 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "cinder-1773e71b-54ef-4ed8-85e9-6ef5799977a8-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-1773e71b-54ef-4ed8-85e9-6ef5799977a8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:50 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b Apr 29 09:06:50 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "cinder-quobyte-1773e71b-54ef-4ed8-85e9-6ef5799977a8" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-quobyte-1773e71b-54ef-4ed8-85e9-6ef5799977a8" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:50 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.708s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:50 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Deleted volume successfully. Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a3fa60-7f8f-4c5b-8b07-620d00e994cc]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cbb6fcdf-727c-4470-a45d-7dfafcd93ca6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-3f4e81c2-7377-4b07-962f-6966c2d77d95-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:50 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8 Apr 29 09:06:50 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:51 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.info" returned: 0 in 0.688s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:51 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.info is being set with open permissions: ugo+rw Apr 29 09:06:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:51 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.info Apr 29 09:06:51 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:51 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b" returned: 0 in 0.862s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:51 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3703b8de-070c-46c7-b8d8-719c8c9c563d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:06:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:51 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d Apr 29 09:06:51 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:51 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8" returned: 0 in 0.752s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:51 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8 Apr 29 09:06:51 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:51 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.info" returned: 0 in 0.722s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.623s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:51 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b14ec6ee-4a9d-4f3a-9390-555566d4d087 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Create snapshot completed successfully Apr 29 09:06:52 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1773e71b-54ef-4ed8-85e9-6ef5799977a8" returned: 0 in 0.601s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-quobyte-1773e71b-54ef-4ed8-85e9-6ef5799977a8" released by "delete_volume" :: held 1.412s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Created reservations ['ba548bf8-cf57-412f-969c-f401676cabde', 'a3f915f6-9037-41af-894c-9fac901ea19c', 'af45bc48-6d82-43e4-8017-336b868e57fc', '9ddc75c5-4132-4324-ae6e-c0bf47513bec'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:52 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:52 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d" returned: 0 in 0.890s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:52 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:52 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d Apr 29 09:06:52 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Acquiring lock "cinder-c38a2b23-9b5a-4c25-9802-016d87d68a84-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "cinder-c38a2b23-9b5a-4c25-9802-016d87d68a84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Acquiring lock "cinder-quobyte-58c74845-7671-43d7-90ca-ef935ab12b6c" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "cinder-quobyte-58c74845-7671-43d7-90ca-ef935ab12b6c" acquired by "delete_snapshot" :: waited 0.041s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Acquiring lock "cinder-quobyte-c38a2b23-9b5a-4c25-9802-016d87d68a84" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "cinder-quobyte-c38a2b23-9b5a-4c25-9802-016d87d68a84" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Deleting offline snapshot c38a2b23-9b5a-4c25-9802-016d87d68a84 of volume 58c74845-7671-43d7-90ca-ef935ab12b6c {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] snapshot_file for this snap is: volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9b771d-409a-482a-9812-a58d034482d1]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "cinder-96d3fda3-6770-4711-bd1a-ae58b21fcbc9-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-96d3fda3-6770-4711-bd1a-ae58b21fcbc9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:52 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.742s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:52 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Deleted volume successfully. Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "cinder-quobyte-96d3fda3-6770-4711-bd1a-ae58b21fcbc9" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-17adda77-0c8b-47d6-9fee-f70da052f41c tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-1773e71b-54ef-4ed8-85e9-6ef5799977a8-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:52 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-quobyte-96d3fda3-6770-4711-bd1a-ae58b21fcbc9" acquired by "delete_volume" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:53 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 Apr 29 09:06:53 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c003017-48b9-4b93-af4c-87cd82c4ac84]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:53 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.b0476337-1179-4483-87d5-eacdc1e4215d" returned: 0 in 0.842s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-b0476337-1179-4483-87d5-eacdc1e4215d" released by "_delete_snapshot" :: held 3.490s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-3703b8de-070c-46c7-b8d8-719c8c9c563d" released by "delete_snapshot" :: held 3.523s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:53 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9 Apr 29 09:06:53 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Created reservations ['f80a6223-5303-4c9f-ac6b-7b2df2c9a572', '83e6cea8-3eb7-4a46-89f6-511042cd864b', '3e2395da-d126-49fd-8a70-c8aa8787d1c3', 'c464e739-b705-4bbc-ace5-63b9089adc1c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:53 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Delete snapshot completed successfully. Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7acdcd55-7976-4970-afb7-c7130841ccff tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-b0476337-1179-4483-87d5-eacdc1e4215d-delete_snapshot" released by "delete_snapshot" :: held 3.703s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:53 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84" returned: 0 in 0.862s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58c74845-7671-43d7-90ca-ef935ab12b6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[214c7cc2-f9f3-4892-b5ab-e26ea151db16]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:53 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c Apr 29 09:06:53 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:53 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "cinder-db80e363-6147-4343-b706-10148dfa057b-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9" returned: 0 in 0.851s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-db80e363-6147-4343-b706-10148dfa057b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "cinder-quobyte-3703b8de-070c-46c7-b8d8-719c8c9c563d" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:53 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9 Apr 29 09:06:53 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-3703b8de-070c-46c7-b8d8-719c8c9c563d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "cinder-quobyte-db80e363-6147-4343-b706-10148dfa057b" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-db80e363-6147-4343-b706-10148dfa057b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Deleting offline snapshot db80e363-6147-4343-b706-10148dfa057b of volume 3703b8de-070c-46c7-b8d8-719c8c9c563d {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:06:53 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] snapshot_file for this snap is: volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[c204aab7-b9eb-48cc-8bd2-c258933b6b48]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:54 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b Apr 29 09:06:54 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:54 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c" returned: 0 in 0.889s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:54 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-96d3fda3-6770-4711-bd1a-ae58b21fcbc9" returned: 0 in 0.750s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:54 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-quobyte-96d3fda3-6770-4711-bd1a-ae58b21fcbc9" released by "delete_volume" :: held 1.651s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:54 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Created reservations ['b89ac3cc-b444-40bf-9ddb-8d4f78ec01ed', 'f5d3c2b3-9271-44ec-a905-98f4ff1b9a63', '35ee162e-a324-49e8-bc04-7808010c0898', 'c9f7eaa3-0820-4686-b5ab-b343b5eccec8'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:54 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b" returned: 0 in 0.802s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3703b8de-070c-46c7-b8d8-719c8c9c563d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:06:54 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:54 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[73252acc-ba45-4edf-b71b-c9422ee2ff82]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:54 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d Apr 29 09:06:54 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:55 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84" returned: 0 in 0.821s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:55 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84 Apr 29 09:06:55 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:55 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.758s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:55 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:55 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Deleted volume successfully. Apr 29 09:06:55 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b7774664-7618-4a40-b56a-40658c36e5a6 tempest-CreateVolumesFromSourceVolumeTest-107163786 None] Lock "cinder-96d3fda3-6770-4711-bd1a-ae58b21fcbc9-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:55 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d" returned: 0 in 0.895s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:55 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b Apr 29 09:06:55 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:56 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c.c38a2b23-9b5a-4c25-9802-016d87d68a84" returned: 0 in 0.704s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:56 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "cinder-quobyte-c38a2b23-9b5a-4c25-9802-016d87d68a84" released by "_delete_snapshot" :: held 3.418s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:56 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "cinder-quobyte-58c74845-7671-43d7-90ca-ef935ab12b6c" released by "delete_snapshot" :: held 3.457s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:56 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Created reservations ['f367910e-b05d-43c6-afbe-772cc31da396', '51fafeb9-7e07-49f7-af7c-fee3e1b61bc7', 'ca2c00a8-9050-41dc-91cc-12fff26ca072', '822baeee-6446-4a28-aa06-c2d7fd45492c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:56 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Delete snapshot completed successfully. Apr 29 09:06:56 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e3f43ca9-0c7a-41f4-bbd0-3651f2f519c2 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "cinder-c38a2b23-9b5a-4c25-9802-016d87d68a84-delete_snapshot" released by "delete_snapshot" :: held 3.645s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:56 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b" returned: 0 in 0.877s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:56 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b Apr 29 09:06:56 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Acquiring lock "cinder-58c74845-7671-43d7-90ca-ef935ab12b6c-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "cinder-58c74845-7671-43d7-90ca-ef935ab12b6c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Acquiring lock "cinder-quobyte-58c74845-7671-43d7-90ca-ef935ab12b6c" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "cinder-quobyte-58c74845-7671-43d7-90ca-ef935ab12b6c" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e2f93-17ab-4d27-aea5-0e43b8ca461c]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:57 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c Apr 29 09:06:57 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:57 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d.db80e363-6147-4343-b706-10148dfa057b" returned: 0 in 0.731s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-db80e363-6147-4343-b706-10148dfa057b" released by "_delete_snapshot" :: held 3.449s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-3703b8de-070c-46c7-b8d8-719c8c9c563d" released by "delete_snapshot" :: held 3.481s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Created reservations ['c77010c3-adf9-478d-91d5-851824b4e5d2', '8063e50d-e853-41a8-9428-fefd4a639bdc', '111be12a-01cc-4907-b457-cbc47741691d', 'ca00bfd4-f83a-4bcb-b1ec-89c9f3375922'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:57 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Delete snapshot completed successfully. Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-26effc7c-37aa-4be8-a338-2903a1664eaf tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-db80e363-6147-4343-b706-10148dfa057b-delete_snapshot" released by "delete_snapshot" :: held 3.642s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:57 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c" returned: 0 in 0.794s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:58 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c Apr 29 09:06:58 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "cinder-3703b8de-070c-46c7-b8d8-719c8c9c563d-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-3703b8de-070c-46c7-b8d8-719c8c9c563d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "cinder-quobyte-3703b8de-070c-46c7-b8d8-719c8c9c563d" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-3703b8de-070c-46c7-b8d8-719c8c9c563d" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[6879de44-ec82-4bb8-8b7e-0651af84ef2e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:58 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d Apr 29 09:06:58 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:58 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-58c74845-7671-43d7-90ca-ef935ab12b6c" returned: 0 in 0.600s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "cinder-quobyte-58c74845-7671-43d7-90ca-ef935ab12b6c" released by "delete_volume" :: held 1.460s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Created reservations ['f3a1bbcd-c707-403f-9cf4-e2d93ae0494d', '889f4be2-3b68-4806-93a3-7df0c50752e3', '1afb21ee-125c-4d5a-af42-9057752db7b6', 'd27b442e-7d83-40a0-b6ef-94790b89b74a'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:58 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:58 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:59 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d" returned: 0 in 0.724s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:59 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d Apr 29 09:06:59 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:59 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.596s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:59 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Deleted volume successfully. Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-2516bb53-5acf-4597-bfbb-b774cab58638 tempest-VolumesSnapshotNegativeTestJSON-1248884716 None] Lock "cinder-58c74845-7671-43d7-90ca-ef935ab12b6c-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:59 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:59 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:59 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-3703b8de-070c-46c7-b8d8-719c8c9c563d" returned: 0 in 0.673s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-quobyte-3703b8de-070c-46c7-b8d8-719c8c9c563d" released by "delete_volume" :: held 1.465s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Created reservations ['cbe3573e-fd06-4d0e-a7f6-7b10687a3ba0', '428ffd5c-135e-4082-9988-67f8e6dce542', 'b7767cf6-a3f7-481d-926d-c6cee2671538', '3f6edaa3-ce80-418c-9466-3672cfd7fa54'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:59 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:06:59 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:00 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.651s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:00 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.702s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:00 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Deleted volume successfully. Apr 29 09:07:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-aa118fc9-817d-43b7-9933-c8c7fcf4d870 tempest-VolumesSnapshotListTestJSON-1800639634 None] Lock "cinder-3703b8de-070c-46c7-b8d8-719c8c9c563d-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Flow 'volume_create_manager' (9ae1c8ec-59bf-49b0-bc6d-36c39300c9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4738cf11-c5ca-41b1-b858-23b995fe2f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4738cf11-c5ca-41b1-b858-23b995fe2f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-939536829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb371276-a629-4a3b-b1d2-b4e4d8590d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae31ae8d12a438fba51119defee776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:02Z,use_quota=True,user_id='fa9eda59a5634058a5167f8f32f94827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e5f1ce-2d34-402d-9320-1ea38c254b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e5f1ce-2d34-402d-9320-1ea38c254b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df396f2-84ab-4926-a675-fa27f4fc8864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df396f2-84ab-4926-a675-fa27f4fc8864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb371276-a629-4a3b-b1d2-b4e4d8590d90', 'volume_name': 'volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9712b2-e087-4a11-935f-e79389a934ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9712b2-e087-4a11-935f-e79389a934ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a61c5f8-b91f-4145-94b6-254839cfe374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:02 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume bb371276-a629-4a3b-b1d2-b4e4d8590d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90', 'volume_size': 1} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-939536829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb371276-a629-4a3b-b1d2-b4e4d8590d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae31ae8d12a438fba51119defee776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:02Z,use_quota=True,user_id='fa9eda59a5634058a5167f8f32f94827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Creating volume bb371276-a629-4a3b-b1d2-b4e4d8590d90 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:02 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:07:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:02 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 1073741824 Apr 29 09:07:02 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:03 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 1073741824" returned: 0 in 0.741s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:03 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 Apr 29 09:07:03 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:03 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90" returned: 0 in 0.561s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a61c5f8-b91f-4145-94b6-254839cfe374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d7f4f7-4866-48d6-bd34-dc78d1aa8b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:03 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 (bb371276-a629-4a3b-b1d2-b4e4d8590d90): created successfully Apr 29 09:07:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d7f4f7-4866-48d6-bd34-dc78d1aa8b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Flow 'volume_create_manager' (9ae1c8ec-59bf-49b0-bc6d-36c39300c9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:03 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c7b3525d-db3f-4ae9-9c8d-4433b9a9d051 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created volume successfully. Apr 29 09:07:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Creating offline snapshot 11b9548c-5619-457e-9d4c-55ec75409876 of volume bb371276-a629-4a3b-b1d2-b4e4d8590d90 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:07:04 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45cc8b7-2de2-4586-8754-f75302ac5de3]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:04 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 Apr 29 09:07:04 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:05 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90" returned: 0 in 0.670s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:05 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 1G Apr 29 09:07:05 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:06 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 1G" returned: 0 in 0.709s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:06 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 Apr 29 09:07:06 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:06 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876" returned: 0 in 0.611s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:06 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 is being set with open permissions: ugo+rw Apr 29 09:07:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:06 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 Apr 29 09:07:06 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:07 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876" returned: 0 in 0.588s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:07 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.info Apr 29 09:07:07 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:07 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.info" returned: 0 in 0.577s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:07 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.info is being set with open permissions: ugo+rw Apr 29 09:07:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:07 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.info Apr 29 09:07:07 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:08 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.info" returned: 0 in 0.596s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.831s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:08 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-065b3273-249a-4bd2-a1c0-481dec9ed7a9 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Create snapshot completed successfully Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Flow 'volume_create_manager' (ca3f698a-a023-4618-a54e-bac6aedf05ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a715281f-cfd7-4e64-bcff-f585be67e6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a715281f-cfd7-4e64-bcff-f585be67e6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1735403910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3db07ae-64e8-4039-b005-9b54e5bdf273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae31ae8d12a438fba51119defee776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:09Z,use_quota=True,user_id='fa9eda59a5634058a5167f8f32f94827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2375ca0e-90e1-4457-aec6-f11a6aa3d4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2375ca0e-90e1-4457-aec6-f11a6aa3d4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea282d09-23f7-4e70-aa33-950a44361cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea282d09-23f7-4e70-aa33-950a44361cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3db07ae-64e8-4039-b005-9b54e5bdf273', 'volume_name': 'volume-c3db07ae-64e8-4039-b005-9b54e5bdf273', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb046edb-5cc0-4495-90c7-e16b2b65d754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb046edb-5cc0-4495-90c7-e16b2b65d754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ed29c7-243e-4da3-a896-330199a390b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume c3db07ae-64e8-4039-b005-9b54e5bdf273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3db07ae-64e8-4039-b005-9b54e5bdf273', 'volume_size': 1} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1735403910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3db07ae-64e8-4039-b005-9b54e5bdf273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae31ae8d12a438fba51119defee776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:09Z,use_quota=True,user_id='fa9eda59a5634058a5167f8f32f94827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Creating volume c3db07ae-64e8-4039-b005-9b54e5bdf273 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:09 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3db07ae-64e8-4039-b005-9b54e5bdf273 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:09 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3db07ae-64e8-4039-b005-9b54e5bdf273 1073741824 Apr 29 09:07:09 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Flow 'volume_create_manager' (af58cf9d-bf42-4182-9048-26cf0090e71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01540358-b844-4fa3-a7e8-b9ab6be8d9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01540358-b844-4fa3-a7e8-b9ab6be8d9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1250216321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468c0bbf-1b24-4efe-b453-f20118b7c9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae31ae8d12a438fba51119defee776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:09Z,use_quota=True,user_id='fa9eda59a5634058a5167f8f32f94827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceca6f16-7813-4f17-8e66-9b25927f1feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceca6f16-7813-4f17-8e66-9b25927f1feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06107ddd-f6ca-49dd-b21b-898aa042b96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06107ddd-f6ca-49dd-b21b-898aa042b96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468c0bbf-1b24-4efe-b453-f20118b7c9f9', 'volume_name': 'volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b7b602-d575-43cb-a357-37d125bf2b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b7b602-d575-43cb-a357-37d125bf2b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a212fc3d-416a-4678-98db-7ec01d12bd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume 468c0bbf-1b24-4efe-b453-f20118b7c9f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9', 'volume_size': 1} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Flow 'volume_create_manager' (46f081e1-1e71-4e5e-a9b2-663a55f8f493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de833f1c-8853-469a-8843-52169f334828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de833f1c-8853-469a-8843-52169f334828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-739169562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabfcb60-1bfa-4821-b0c5-61548613db4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae31ae8d12a438fba51119defee776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:10Z,use_quota=True,user_id='fa9eda59a5634058a5167f8f32f94827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cb70bd-b288-4721-a8df-ccde85b4a30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cb70bd-b288-4721-a8df-ccde85b4a30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5982a30c-715c-4257-b561-95b3743a121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5982a30c-715c-4257-b561-95b3743a121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aabfcb60-1bfa-4821-b0c5-61548613db4e', 'volume_name': 'volume-aabfcb60-1bfa-4821-b0c5-61548613db4e', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd8c3e9-ba3f-4165-ae6a-95e96c53a5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd8c3e9-ba3f-4165-ae6a-95e96c53a5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef8c0da-d1f9-43f7-b95d-ff1203018c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume aabfcb60-1bfa-4821-b0c5-61548613db4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aabfcb60-1bfa-4821-b0c5-61548613db4e', 'volume_size': 1} Apr 29 09:07:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:10 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3db07ae-64e8-4039-b005-9b54e5bdf273 1073741824" returned: 0 in 0.846s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3db07ae-64e8-4039-b005-9b54e5bdf273 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:10 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3db07ae-64e8-4039-b005-9b54e5bdf273 Apr 29 09:07:10 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Flow 'volume_create_manager' (0227c6d2-fb7a-4d64-9d37-26fc32968b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67aef895-cf61-4035-baae-43fc853251de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67aef895-cf61-4035-baae-43fc853251de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1001013623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdae408-8024-4e2f-a1c3-f028b70e8016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae31ae8d12a438fba51119defee776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:10Z,use_quota=True,user_id='fa9eda59a5634058a5167f8f32f94827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38f3251-7e93-43ae-aa66-89aaa04024d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38f3251-7e93-43ae-aa66-89aaa04024d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408746eb-9684-4f75-bbd5-d967b6e925f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408746eb-9684-4f75-bbd5-d967b6e925f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebdae408-8024-4e2f-a1c3-f028b70e8016', 'volume_name': 'volume-ebdae408-8024-4e2f-a1c3-f028b70e8016', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379cfc01-82cf-4e17-9b48-5ad8a478cfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379cfc01-82cf-4e17-9b48-5ad8a478cfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49ac654-1fd8-4ecf-a48e-27584dd41ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:10 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume ebdae408-8024-4e2f-a1c3-f028b70e8016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebdae408-8024-4e2f-a1c3-f028b70e8016', 'volume_size': 1} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Flow 'volume_create_manager' (2bbd2f01-5cc7-4084-83d7-432ce6e459ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf7196b-a7ba-4eb4-ade1-2418ae2cb246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf7196b-a7ba-4eb4-ade1-2418ae2cb246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7625545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae31ae8d12a438fba51119defee776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:11Z,use_quota=True,user_id='fa9eda59a5634058a5167f8f32f94827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bf200d-7db6-472c-97d7-9a7931121ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bf200d-7db6-472c-97d7-9a7931121ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7578ae1-70d6-461a-a0b0-a7480038ad0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7578ae1-70d6-461a-a0b0-a7480038ad0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8', 'volume_name': 'volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86aa6781-ed84-4aaf-8d6e-889f94f8dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86aa6781-ed84-4aaf-8d6e-889f94f8dd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3728900d-feb8-4b47-8a10-5ddd7b298c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:10 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8', 'volume_size': 1} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:10 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3db07ae-64e8-4039-b005-9b54e5bdf273" returned: 0 in 0.618s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.195s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1250216321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468c0bbf-1b24-4efe-b453-f20118b7c9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae31ae8d12a438fba51119defee776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:09Z,use_quota=True,user_id='fa9eda59a5634058a5167f8f32f94827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Creating volume 468c0bbf-1b24-4efe-b453-f20118b7c9f9 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:10 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:10 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9 1073741824 Apr 29 09:07:10 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ed29c7-243e-4da3-a896-330199a390b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3db07ae-64e8-4039-b005-9b54e5bdf273', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a829b9-b987-4995-b30b-aa26689f5ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:10 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume volume-c3db07ae-64e8-4039-b005-9b54e5bdf273 (c3db07ae-64e8-4039-b005-9b54e5bdf273): created successfully Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a829b9-b987-4995-b30b-aa26689f5ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:10 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Flow 'volume_create_manager' (ca3f698a-a023-4618-a54e-bac6aedf05ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:10 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-1f935455-10c3-404c-8722-7722057de61d tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created volume successfully. Apr 29 09:07:11 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9 1073741824" returned: 0 in 0.791s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:11 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9 Apr 29 09:07:11 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:12 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9" returned: 0 in 0.584s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.302s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-739169562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabfcb60-1bfa-4821-b0c5-61548613db4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae31ae8d12a438fba51119defee776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:10Z,use_quota=True,user_id='fa9eda59a5634058a5167f8f32f94827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Creating volume aabfcb60-1bfa-4821-b0c5-61548613db4e {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:12 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aabfcb60-1bfa-4821-b0c5-61548613db4e 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a212fc3d-416a-4678-98db-7ec01d12bd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:12 devstack sudo[92735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aabfcb60-1bfa-4821-b0c5-61548613db4e 1073741824 Apr 29 09:07:12 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26225448-c7f5-4a65-9207-a92ef05ca2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:12 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9 (468c0bbf-1b24-4efe-b453-f20118b7c9f9): created successfully Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26225448-c7f5-4a65-9207-a92ef05ca2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Flow 'volume_create_manager' (af58cf9d-bf42-4182-9048-26cf0090e71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:12 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e675d8f8-af5c-46f0-af9e-5d741d740c0a tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created volume successfully. Apr 29 09:07:13 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aabfcb60-1bfa-4821-b0c5-61548613db4e 1073741824" returned: 0 in 0.777s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aabfcb60-1bfa-4821-b0c5-61548613db4e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:13 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aabfcb60-1bfa-4821-b0c5-61548613db4e Apr 29 09:07:13 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:13 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aabfcb60-1bfa-4821-b0c5-61548613db4e" returned: 0 in 0.578s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.332s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1001013623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdae408-8024-4e2f-a1c3-f028b70e8016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae31ae8d12a438fba51119defee776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:10Z,use_quota=True,user_id='fa9eda59a5634058a5167f8f32f94827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Creating volume ebdae408-8024-4e2f-a1c3-f028b70e8016 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:13 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ebdae408-8024-4e2f-a1c3-f028b70e8016 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:13 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ebdae408-8024-4e2f-a1c3-f028b70e8016 1073741824 Apr 29 09:07:13 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef8c0da-d1f9-43f7-b95d-ff1203018c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aabfcb60-1bfa-4821-b0c5-61548613db4e', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73f630e-1584-4bf8-bad1-14db01490756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:13 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume volume-aabfcb60-1bfa-4821-b0c5-61548613db4e (aabfcb60-1bfa-4821-b0c5-61548613db4e): created successfully Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73f630e-1584-4bf8-bad1-14db01490756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Flow 'volume_create_manager' (46f081e1-1e71-4e5e-a9b2-663a55f8f493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:13 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-cf2d8898-06f2-4508-bd39-40ba8ae1f54e tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created volume successfully. Apr 29 09:07:14 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ebdae408-8024-4e2f-a1c3-f028b70e8016 1073741824" returned: 0 in 0.755s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ebdae408-8024-4e2f-a1c3-f028b70e8016 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:14 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ebdae408-8024-4e2f-a1c3-f028b70e8016 Apr 29 09:07:14 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:14 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ebdae408-8024-4e2f-a1c3-f028b70e8016" returned: 0 in 0.582s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:14 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.369s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7625545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae31ae8d12a438fba51119defee776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:11Z,use_quota=True,user_id='fa9eda59a5634058a5167f8f32f94827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Creating volume b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:15 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:15 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8 1073741824 Apr 29 09:07:15 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49ac654-1fd8-4ecf-a48e-27584dd41ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebdae408-8024-4e2f-a1c3-f028b70e8016', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbfa1d2-b027-4e3a-970b-c61331b8154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:15 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume volume-ebdae408-8024-4e2f-a1c3-f028b70e8016 (ebdae408-8024-4e2f-a1c3-f028b70e8016): created successfully Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbfa1d2-b027-4e3a-970b-c61331b8154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Flow 'volume_create_manager' (0227c6d2-fb7a-4d64-9d37-26fc32968b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:15 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b5561bef-1278-4c45-9878-3843fd7bc455 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created volume successfully. Apr 29 09:07:15 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8 1073741824" returned: 0 in 0.754s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:15 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8 Apr 29 09:07:15 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:16 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8" returned: 0 in 0.586s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:16 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3728900d-feb8-4b47-8a10-5ddd7b298c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a7a4db-0367-4718-bd1d-2e66c0182b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:16 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Volume volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8 (b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8): created successfully Apr 29 09:07:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a7a4db-0367-4718-bd1d-2e66c0182b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:16 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Flow 'volume_create_manager' (2bbd2f01-5cc7-4084-83d7-432ce6e459ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:16 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-42fb9610-d537-419c-888b-0ba971177d38 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created volume successfully. Apr 29 09:07:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-quobyte-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:17 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e77426b-4cb2-49a6-932c-f1c2bec23a52]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:17 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8 Apr 29 09:07:17 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:17 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8" returned: 0 in 0.699s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:18 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8 Apr 29 09:07:18 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:18 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8" returned: 0 in 0.591s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8" released by "delete_volume" :: held 1.325s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:18 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created reservations ['e2d7c806-d165-49c1-b635-1ad71f3b0c30', '81d89b46-5f90-492b-bd84-9afbabfdea1d', 'f356c8d6-6ea2-4461-aa12-278fb0d3c990', 'e1d344f9-b6df-4316-87d9-7b696f08c4f2'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:18 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:07:18 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:19 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.574s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:19 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:19 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Deleted volume successfully. Apr 29 09:07:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-784e070b-d378-4f19-be0e-f230186720e0 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-b42fd11b-84c1-4ed3-a4d0-dc89c7c297b8-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-ebdae408-8024-4e2f-a1c3-f028b70e8016-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-ebdae408-8024-4e2f-a1c3-f028b70e8016-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-quobyte-ebdae408-8024-4e2f-a1c3-f028b70e8016" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-ebdae408-8024-4e2f-a1c3-f028b70e8016" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:19 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b399da5-0dc4-4b12-8076-4bfcd4066da5]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ebdae408-8024-4e2f-a1c3-f028b70e8016 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:19 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ebdae408-8024-4e2f-a1c3-f028b70e8016 Apr 29 09:07:19 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:20 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ebdae408-8024-4e2f-a1c3-f028b70e8016" returned: 0 in 0.777s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ebdae408-8024-4e2f-a1c3-f028b70e8016 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:20 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ebdae408-8024-4e2f-a1c3-f028b70e8016 Apr 29 09:07:20 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:20 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ebdae408-8024-4e2f-a1c3-f028b70e8016" returned: 0 in 0.662s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-ebdae408-8024-4e2f-a1c3-f028b70e8016" released by "delete_volume" :: held 1.475s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created reservations ['f5b0f6ad-1c2d-4710-9b74-5f280477177f', 'a42e11f2-b6fb-4e02-bffe-1a3f504b9878', '4fe6783b-23da-4cd1-b0aa-addd34bf0ec4', '2c6f559d-fc00-424e-8901-e5c023977cfa'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:21 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:07:21 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-aabfcb60-1bfa-4821-b0c5-61548613db4e-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-aabfcb60-1bfa-4821-b0c5-61548613db4e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:21 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.612s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:21 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Deleted volume successfully. Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-quobyte-aabfcb60-1bfa-4821-b0c5-61548613db4e" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-44b675a5-2d89-49da-937a-4491683bc011 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-ebdae408-8024-4e2f-a1c3-f028b70e8016-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-aabfcb60-1bfa-4821-b0c5-61548613db4e" acquired by "delete_volume" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[395578c3-e09b-4b12-84a6-8f78c70208d0]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aabfcb60-1bfa-4821-b0c5-61548613db4e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:21 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aabfcb60-1bfa-4821-b0c5-61548613db4e Apr 29 09:07:21 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:22 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aabfcb60-1bfa-4821-b0c5-61548613db4e" returned: 0 in 0.722s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aabfcb60-1bfa-4821-b0c5-61548613db4e {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:22 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aabfcb60-1bfa-4821-b0c5-61548613db4e Apr 29 09:07:22 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:23 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-aabfcb60-1bfa-4821-b0c5-61548613db4e" returned: 0 in 0.576s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-aabfcb60-1bfa-4821-b0c5-61548613db4e" released by "delete_volume" :: held 1.336s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=143,cinder:UPDATE=169,cinder:INSERT=54,cinder:DELETE=14 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created reservations ['56304247-ca9b-43a8-9079-f3804278fbcc', '93b73f2d-139e-47c3-a4d7-3bc992fa4539', 'db36e659-0094-44f0-bfd4-223c4b901edc', '47d4d886-9526-44ea-8355-4ec7a57406c0'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:23 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:07:23 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:23 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.569s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:23 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Deleted volume successfully. Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8cdcf8e5-15d5-4681-8e2f-8594d6725242 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-aabfcb60-1bfa-4821-b0c5-61548613db4e-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-468c0bbf-1b24-4efe-b453-f20118b7c9f9-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-468c0bbf-1b24-4efe-b453-f20118b7c9f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-quobyte-468c0bbf-1b24-4efe-b453-f20118b7c9f9" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-468c0bbf-1b24-4efe-b453-f20118b7c9f9" acquired by "delete_volume" :: waited 0.013s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb84082-1b1a-4c70-bafd-9d1b9751a16b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:24 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9 Apr 29 09:07:24 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:24 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9" returned: 0 in 0.689s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:24 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9 Apr 29 09:07:24 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:25 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-468c0bbf-1b24-4efe-b453-f20118b7c9f9" returned: 0 in 0.559s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-468c0bbf-1b24-4efe-b453-f20118b7c9f9" released by "delete_volume" :: held 1.285s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:25 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created reservations ['6cdba943-ac5f-4914-a0d3-c13516364921', 'd8ba4509-ebde-4c14-8e23-733e54e3a1d8', '66066250-9b91-4834-a46d-936ec519dd73', 'f64c29bc-cbc0-4e4e-ad8e-032c14a1c792'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:25 devstack sudo[92804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:07:25 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:25 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.575s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:25 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:25 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Deleted volume successfully. Apr 29 09:07:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4c92a953-bad0-412c-9a14-e3f864f3c230 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-468c0bbf-1b24-4efe-b453-f20118b7c9f9-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:26 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-c3db07ae-64e8-4039-b005-9b54e5bdf273-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:26 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-c3db07ae-64e8-4039-b005-9b54e5bdf273-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:26 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-quobyte-c3db07ae-64e8-4039-b005-9b54e5bdf273" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:26 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-c3db07ae-64e8-4039-b005-9b54e5bdf273" acquired by "delete_volume" :: waited 0.015s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:26 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[267db5f2-28a9-4ce5-858e-18b5dc222d26]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3db07ae-64e8-4039-b005-9b54e5bdf273 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:26 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3db07ae-64e8-4039-b005-9b54e5bdf273 Apr 29 09:07:26 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:26 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3db07ae-64e8-4039-b005-9b54e5bdf273" returned: 0 in 0.698s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3db07ae-64e8-4039-b005-9b54e5bdf273 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:26 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3db07ae-64e8-4039-b005-9b54e5bdf273 Apr 29 09:07:26 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:27 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-c3db07ae-64e8-4039-b005-9b54e5bdf273" returned: 0 in 0.582s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-c3db07ae-64e8-4039-b005-9b54e5bdf273" released by "delete_volume" :: held 1.321s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:27 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created reservations ['1d63a807-c120-4c2e-a554-5df195ff9bb4', '4abfef6d-fecd-4e55-b577-473da3083f00', '618a742c-0e9f-4a16-add0-5b9ef27a69ca', '0e51dd6f-f07a-4ba4-a21a-3aa3e7855c7e'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:27 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:07:27 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:28 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.587s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:28 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Deleted volume successfully. Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1cbb6c5c-bb0d-465d-ba3d-341e6a60d4dc tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-c3db07ae-64e8-4039-b005-9b54e5bdf273-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-11b9548c-5619-457e-9d4c-55ec75409876-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-11b9548c-5619-457e-9d4c-55ec75409876-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-quobyte-bb371276-a629-4a3b-b1d2-b4e4d8590d90" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-bb371276-a629-4a3b-b1d2-b4e4d8590d90" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-quobyte-11b9548c-5619-457e-9d4c-55ec75409876" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-11b9548c-5619-457e-9d4c-55ec75409876" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Deleting offline snapshot 11b9548c-5619-457e-9d4c-55ec75409876 of volume bb371276-a629-4a3b-b1d2-b4e4d8590d90 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] snapshot_file for this snap is: volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[47107964-2f59-4755-928f-d3786138653e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:28 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 Apr 29 09:07:28 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:29 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876" returned: 0 in 0.709s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:29 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:07:29 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[d723edbb-078a-4f5a-b622-892709401cc2]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:29 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 Apr 29 09:07:29 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:29 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90" returned: 0 in 0.702s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:29 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 Apr 29 09:07:29 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:30 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876" returned: 0 in 0.701s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:30 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876 Apr 29 09:07:30 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:31 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90.11b9548c-5619-457e-9d4c-55ec75409876" returned: 0 in 0.611s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-11b9548c-5619-457e-9d4c-55ec75409876" released by "_delete_snapshot" :: held 2.825s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-bb371276-a629-4a3b-b1d2-b4e4d8590d90" released by "delete_snapshot" :: held 2.851s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:31 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created reservations ['18491278-03bb-4afc-b9da-6390cced39fe', 'dbaf3b35-f64e-4a1b-a0e8-f8be5ffbb56a', '17d9a6e3-ba9c-424b-aec5-4a7b4fd12904', 'c996cc40-0880-4859-bc07-cf9cca17c8b6'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:31 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Delete snapshot completed successfully. Apr 29 09:07:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-09ce580a-373b-44cf-a983-03392e291f1b tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-11b9548c-5619-457e-9d4c-55ec75409876-delete_snapshot" released by "delete_snapshot" :: held 3.038s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-bb371276-a629-4a3b-b1d2-b4e4d8590d90-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-bb371276-a629-4a3b-b1d2-b4e4d8590d90-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "cinder-quobyte-bb371276-a629-4a3b-b1d2-b4e4d8590d90" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-bb371276-a629-4a3b-b1d2-b4e4d8590d90" acquired by "delete_volume" :: waited 0.015s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:31 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a72c8d-b4ef-43bd-a64b-486339070268]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:31 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 Apr 29 09:07:31 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:32 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90" returned: 0 in 0.707s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:32 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90 Apr 29 09:07:32 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:32 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-bb371276-a629-4a3b-b1d2-b4e4d8590d90" returned: 0 in 0.595s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-quobyte-bb371276-a629-4a3b-b1d2-b4e4d8590d90" released by "delete_volume" :: held 1.361s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:32 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Created reservations ['1a4dc64f-37c5-444f-94fb-ef22808efec2', 'f7bc93bd-7786-487f-978a-465c874092ee', 'cd23d801-8d56-468b-85ee-ca571e7c23ef', 'f44fc707-8532-4bd2-8733-baae17c26cbd'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:32 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:33 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:33 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:07:33 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:33 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.567s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:33 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:33 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Deleted volume successfully. Apr 29 09:07:33 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9acc8015-c63a-4751-b626-445fc8916172 tempest-CreateVolumesFromSnapshotTest-1965583457 None] Lock "cinder-bb371276-a629-4a3b-b1d2-b4e4d8590d90-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Flow 'volume_create_manager' (506202ef-bc7c-46db-9541-9877fd774be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5e0d0b-eaae-4f72-86e0-acdfe6bd33b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5e0d0b-eaae-4f72-86e0-acdfe6bd33b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1371878647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92274ab3-0184-472c-8e1a-0f4a072d421c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563dfa029c7449f0bd6a6488d712ab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:36Z,use_quota=True,user_id='187774cf61d84b0eb866138bb2b59236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae74c7e2-5873-48fc-96f1-a30d7c3082f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae74c7e2-5873-48fc-96f1-a30d7c3082f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fddf51-c1f8-4e2d-8a2e-4460ccab53fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fddf51-c1f8-4e2d-8a2e-4460ccab53fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92274ab3-0184-472c-8e1a-0f4a072d421c', 'volume_name': 'volume-92274ab3-0184-472c-8e1a-0f4a072d421c', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab9ae1d-bc5a-4ec3-bb7a-4fb79e80d972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab9ae1d-bc5a-4ec3-bb7a-4fb79e80d972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adebabe-aaf4-4eba-8831-538321077f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:36 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Volume 92274ab3-0184-472c-8e1a-0f4a072d421c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92274ab3-0184-472c-8e1a-0f4a072d421c', 'volume_size': 1} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1371878647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92274ab3-0184-472c-8e1a-0f4a072d421c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563dfa029c7449f0bd6a6488d712ab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:36Z,use_quota=True,user_id='187774cf61d84b0eb866138bb2b59236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Creating volume 92274ab3-0184-472c-8e1a-0f4a072d421c {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:36 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:07:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:36 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c 1073741824 Apr 29 09:07:36 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:37 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c 1073741824" returned: 0 in 0.746s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:37 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c Apr 29 09:07:37 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:37 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c" returned: 0 in 0.588s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adebabe-aaf4-4eba-8831-538321077f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92274ab3-0184-472c-8e1a-0f4a072d421c', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ce8732-f170-4cce-a102-7151f59c6d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:37 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Volume volume-92274ab3-0184-472c-8e1a-0f4a072d421c (92274ab3-0184-472c-8e1a-0f4a072d421c): created successfully Apr 29 09:07:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ce8732-f170-4cce-a102-7151f59c6d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Flow 'volume_create_manager' (506202ef-bc7c-46db-9541-9877fd774be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:37 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-44a5cdf6-8d02-495b-beb5-3d0d119dad7e tempest-VolumeDependencyTests-710706439 None] Created volume successfully. Apr 29 09:07:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:38 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] Creating offline snapshot 424cbab5-24d1-4268-b35c-1fde5b2b1c77 of volume 92274ab3-0184-472c-8e1a-0f4a072d421c {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:07:38 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1d2976-02b6-4ad7-9c6d-5e4870b23fd5]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:38 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c Apr 29 09:07:38 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:39 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c" returned: 0 in 0.663s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:39 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 1G Apr 29 09:07:39 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:40 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 1G" returned: 0 in 0.771s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92274ab3-0184-472c-8e1a-0f4a072d421c -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:40 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92274ab3-0184-472c-8e1a-0f4a072d421c -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 Apr 29 09:07:40 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:40 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92274ab3-0184-472c-8e1a-0f4a072d421c -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77" returned: 0 in 0.617s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:40 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 is being set with open permissions: ugo+rw Apr 29 09:07:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:40 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 Apr 29 09:07:40 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:41 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77" returned: 0 in 0.562s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:41 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.info Apr 29 09:07:41 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:41 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.info" returned: 0 in 0.599s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:41 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.info is being set with open permissions: ugo+rw Apr 29 09:07:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:41 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.info Apr 29 09:07:41 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:42 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.info" returned: 0 in 0.562s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.858s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:42 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c0ee2dd0-9b9d-4f6b-9774-e6f259d01d3c tempest-VolumeDependencyTests-710706439 None] Create snapshot completed successfully Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Flow 'volume_create_manager' (4a7a3934-daeb-4b91-b2b2-531825ccadb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64912f8f-3737-4352-a397-455a1e7ce677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64912f8f-3737-4352-a397-455a1e7ce677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-783448785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e6a37e-85ce-4c4c-97bc-82f282812b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563dfa029c7449f0bd6a6488d712ab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=424cbab5-24d1-4268-b35c-1fde5b2b1c77,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:43Z,use_quota=True,user_id='187774cf61d84b0eb866138bb2b59236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc7b7db-4020-4290-b9c5-e4124b1017c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc7b7db-4020-4290-b9c5-e4124b1017c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa553d76-8532-439e-937c-672cc4fccee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa553d76-8532-439e-937c-672cc4fccee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e0e6a37e-85ce-4c4c-97bc-82f282812b39', 'volume_name': 'volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39', 'volume_size': 1, 'snapshot_id': '424cbab5-24d1-4268-b35c-1fde5b2b1c77'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75502d97-c342-48a0-8943-62c7f8f2e361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75502d97-c342-48a0-8943-62c7f8f2e361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74241c54-7782-498c-bc2e-906c1ec67674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:43 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Volume e0e6a37e-85ce-4c4c-97bc-82f282812b39: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39', 'volume_size': 1, 'snapshot_id': '424cbab5-24d1-4268-b35c-1fde5b2b1c77'} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-quobyte-424cbab5-24d1-4268-b35c-1fde5b2b1c77-e0e6a37e-85ce-4c4c-97bc-82f282812b39" by "_create_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-424cbab5-24d1-4268-b35c-1fde5b2b1c77-e0e6a37e-85ce-4c4c-97bc-82f282812b39" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Creating volume e0e6a37e-85ce-4c4c-97bc-82f282812b39 from snapshot 424cbab5-24d1-4268-b35c-1fde5b2b1c77 {{(pid=83712) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-quobyte-e0e6a37e-85ce-4c4c-97bc-82f282812b39" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-e0e6a37e-85ce-4c4c-97bc-82f282812b39" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] snapshot: 424cbab5-24d1-4268-b35c-1fde5b2b1c77, volume: e0e6a37e-85ce-4c4c-97bc-82f282812b39, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa26ca98-28bc-4b4b-aeec-b1ac7ab54687]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:43 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 Apr 29 09:07:43 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:44 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77" returned: 0 in 0.695s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92274ab3-0184-472c-8e1a-0f4a072d421c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:07:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:07:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:07:44 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44a19f1-9ea1-4eae-8bca-2b4d06f87cdd]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:44 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c Apr 29 09:07:44 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:44 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c" returned: 0 in 0.685s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:44 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39 not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:07:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:44 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39 Apr 29 09:07:44 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:49 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39" returned: 0 in 4.457s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:49 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[57439e5a-530d-4d17-9475-c8578c5e233f]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:49 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:49 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c Apr 29 09:07:49 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:50 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c" returned: 0 in 0.822s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39 {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:07:50 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Converted 1024.00 MB image at 229.69 MB/s Apr 29 09:07:50 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39 is being set with open permissions: ugo+rw Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:50 devstack sudo[92956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39 Apr 29 09:07:50 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:50 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39" returned: 0 in 0.562s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-e0e6a37e-85ce-4c4c-97bc-82f282812b39" released by "_copy_volume_from_snapshot" :: held 7.314s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-424cbab5-24d1-4268-b35c-1fde5b2b1c77-e0e6a37e-85ce-4c4c-97bc-82f282812b39" released by "_create_volume_from_snapshot" :: held 7.342s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.357s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:INSERT=35,cinder:UPDATE=129,cinder:SELECT=96,cinder:DELETE=14 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74241c54-7782-498c-bc2e-906c1ec67674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39', 'volume_size': 1, 'snapshot_id': '424cbab5-24d1-4268-b35c-1fde5b2b1c77'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d2f67a-c71a-4a3d-83b5-f22101ff927e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:50 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Volume volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39 (e0e6a37e-85ce-4c4c-97bc-82f282812b39): created successfully Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d2f67a-c71a-4a3d-83b5-f22101ff927e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Flow 'volume_create_manager' (4a7a3934-daeb-4b91-b2b2-531825ccadb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:50 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8bc80c08-af61-48de-b529-97ec8f0a8f43 tempest-VolumeDependencyTests-710706439 None] Created volume successfully. Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-424cbab5-24d1-4268-b35c-1fde5b2b1c77-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Lock "cinder-424cbab5-24d1-4268-b35c-1fde5b2b1c77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-quobyte-92274ab3-0184-472c-8e1a-0f4a072d421c" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-92274ab3-0184-472c-8e1a-0f4a072d421c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-quobyte-424cbab5-24d1-4268-b35c-1fde5b2b1c77" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-424cbab5-24d1-4268-b35c-1fde5b2b1c77" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Deleting offline snapshot 424cbab5-24d1-4268-b35c-1fde5b2b1c77 of volume 92274ab3-0184-472c-8e1a-0f4a072d421c {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] snapshot_file for this snap is: volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9716a8-fdd3-4680-ac98-77e429780b23]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:50 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:51 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 Apr 29 09:07:51 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:51 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77" returned: 0 in 0.686s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:51 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92274ab3-0184-472c-8e1a-0f4a072d421c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:07:51 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc43c387-5644-4407-9d1a-f96e3d1c3531]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:51 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:51 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c Apr 29 09:07:51 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:52 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c" returned: 0 in 0.695s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:52 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 Apr 29 09:07:52 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:53 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77" returned: 0 in 0.779s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:53 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77 Apr 29 09:07:53 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:53 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c.424cbab5-24d1-4268-b35c-1fde5b2b1c77" returned: 0 in 0.676s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-424cbab5-24d1-4268-b35c-1fde5b2b1c77" released by "_delete_snapshot" :: held 2.938s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-92274ab3-0184-472c-8e1a-0f4a072d421c" released by "delete_snapshot" :: held 2.958s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:53 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Created reservations ['cbcf4b8d-7839-4e83-9fdd-a3a0ce6a0a2a', 'e0da750a-cb52-4de4-805f-68d992acf0da', '5e617951-0f20-41ee-8ef4-ef61ce79c07d', 'fa5bd584-a8c2-4620-a81a-df2ecb13e07c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:53 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Delete snapshot completed successfully. Apr 29 09:07:53 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1d005c3e-79c5-4fc9-afdc-b265d940056f tempest-VolumeDependencyTests-710706439 None] Lock "cinder-424cbab5-24d1-4268-b35c-1fde5b2b1c77-delete_snapshot" released by "delete_snapshot" :: held 3.107s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-92274ab3-0184-472c-8e1a-0f4a072d421c-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Lock "cinder-92274ab3-0184-472c-8e1a-0f4a072d421c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-quobyte-92274ab3-0184-472c-8e1a-0f4a072d421c" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-92274ab3-0184-472c-8e1a-0f4a072d421c" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:54 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84c8c4b-bf31-4c9e-a67a-8306adc3b403]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:54 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c Apr 29 09:07:54 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:55 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c" returned: 0 in 0.839s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:55 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c Apr 29 09:07:55 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:55 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-92274ab3-0184-472c-8e1a-0f4a072d421c" returned: 0 in 0.730s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:55 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-92274ab3-0184-472c-8e1a-0f4a072d421c" released by "delete_volume" :: held 1.634s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:55 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Created reservations ['12262e9c-6d7e-4f35-aa91-1d5d8dd81513', 'c1e42782-2686-42b6-a003-2aedf6ca1a96', '6a6f6242-5b4f-4f5c-9ca2-7cdf5e188b4f', '9aaa232e-c941-46df-9395-fee3a903011a'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:55 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:07:55 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:56 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.689s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:56 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Deleted volume successfully. Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-db7d2666-2903-4116-ad11-d4c9bc222461 tempest-VolumeDependencyTests-710706439 None] Lock "cinder-92274ab3-0184-472c-8e1a-0f4a072d421c-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Flow 'volume_create_manager' (5f686b26-c53b-431d-b77b-ef4970aa2c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec21219-2600-49c4-9c56-2827257953b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec21219-2600-49c4-9c56-2827257953b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-624154594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc1ac3f-f5dd-470c-9e37-a997f2378af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563dfa029c7449f0bd6a6488d712ab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:57Z,use_quota=True,user_id='187774cf61d84b0eb866138bb2b59236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c956353e-9ae7-427e-a211-6a29f581632d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c956353e-9ae7-427e-a211-6a29f581632d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe46f7ff-d4b7-4871-ad6f-1ee16a97954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe46f7ff-d4b7-4871-ad6f-1ee16a97954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc1ac3f-f5dd-470c-9e37-a997f2378af3', 'volume_name': 'volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d2183d-907b-41c3-845c-20518fe55331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d2183d-907b-41c3-845c-20518fe55331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7c529d-f819-4f10-8997-e684049ff2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:56 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Volume 9cc1ac3f-f5dd-470c-9e37-a997f2378af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3', 'volume_size': 1} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-624154594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc1ac3f-f5dd-470c-9e37-a997f2378af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563dfa029c7449f0bd6a6488d712ab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:57Z,use_quota=True,user_id='187774cf61d84b0eb866138bb2b59236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Creating volume 9cc1ac3f-f5dd-470c-9e37-a997f2378af3 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:56 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:07:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:56 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 1073741824 Apr 29 09:07:56 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:57 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 1073741824" returned: 0 in 0.939s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:57 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 Apr 29 09:07:57 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:58 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3" returned: 0 in 0.650s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7c529d-f819-4f10-8997-e684049ff2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c82ec7-fab4-4b58-b5b6-0abea1b0f0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:58 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Volume volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 (9cc1ac3f-f5dd-470c-9e37-a997f2378af3): created successfully Apr 29 09:07:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c82ec7-fab4-4b58-b5b6-0abea1b0f0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Flow 'volume_create_manager' (5f686b26-c53b-431d-b77b-ef4970aa2c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:58 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-64de860d-1b21-4471-8465-01b5fdef0ac0 tempest-VolumeDependencyTests-710706439 None] Created volume successfully. Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Flow 'volume_create_manager' (51bbcbec-09e8-4628-a39c-f6a6482105be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da99557-6614-4d8b-a11b-9ae4500216c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da99557-6614-4d8b-a11b-9ae4500216c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-948972507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7aa9d76-659a-481b-aab5-3fd3bc3036fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563dfa029c7449f0bd6a6488d712ab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9cc1ac3f-f5dd-470c-9e37-a997f2378af3,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:59Z,use_quota=True,user_id='187774cf61d84b0eb866138bb2b59236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db221308-7efb-48b8-80d8-e0daf9bea8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db221308-7efb-48b8-80d8-e0daf9bea8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421e4fb2-aef2-4b3a-ac66-53fd6b9817c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421e4fb2-aef2-4b3a-ac66-53fd6b9817c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e7aa9d76-659a-481b-aab5-3fd3bc3036fa', 'volume_name': 'volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa', 'volume_size': 1, 'source_volid': '9cc1ac3f-f5dd-470c-9e37-a997f2378af3', 'source_volstatus': 'available'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297edc90-c4f7-485d-afca-f0ad358d9a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297edc90-c4f7-485d-afca-f0ad358d9a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2f6099-3d21-417b-96c1-82a51b40dbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:59 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Volume e7aa9d76-659a-481b-aab5-3fd3bc3036fa: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa', 'volume_size': 1, 'source_volid': '9cc1ac3f-f5dd-470c-9e37-a997f2378af3', 'source_volstatus': 'available'} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:59 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Cloning volume 9cc1ac3f-f5dd-470c-9e37-a997f2378af3 to volume e7aa9d76-659a-481b-aab5-3fd3bc3036fa Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Creating offline snapshot 461cb599-ec4b-465c-bbe7-de7aff2c9062 of volume 9cc1ac3f-f5dd-470c-9e37-a997f2378af3 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[7634f42a-afef-4d7a-ad18-c262a067d698]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:59 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:07:59 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:59 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 Apr 29 09:07:59 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:00 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.584s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:00 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3" returned: 0 in 0.748s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:00 devstack sudo[93009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 1G Apr 29 09:08:00 devstack sudo[93009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:01 devstack sudo[93009]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 1G" returned: 0 in 0.744s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:01 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 Apr 29 09:08:01 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:01 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062" returned: 0 in 0.792s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:01 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 is being set with open permissions: ugo+rw Apr 29 09:08:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:01 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 Apr 29 09:08:01 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:02 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062" returned: 0 in 0.738s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:02 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.info Apr 29 09:08:02 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:03 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.info" returned: 0 in 0.647s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:03 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.info is being set with open permissions: ugo+rw Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:03 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.info Apr 29 09:08:03 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:03 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.info" returned: 0 in 0.662s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-quobyte-e7aa9d76-659a-481b-aab5-3fd3bc3036fa" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-e7aa9d76-659a-481b-aab5-3fd3bc3036fa" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] snapshot: 461cb599-ec4b-465c-bbe7-de7aff2c9062, volume: e7aa9d76-659a-481b-aab5-3fd3bc3036fa, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd354425-c114-4049-9186-5eff6e9fb492]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:04 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 Apr 29 09:08:04 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:04 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062" returned: 0 in 0.702s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:08:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:08:04 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:08:04 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf929528-7e69-408f-ab68-2fa3219ec9b7]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:04 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 Apr 29 09:08:04 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:05 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3" returned: 0 in 0.702s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:05 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:08:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:05 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa Apr 29 09:08:05 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:09 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa" returned: 0 in 4.450s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:09 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39b18af-8d75-427f-99ef-5012aee63e1d]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:09 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 Apr 29 09:08:09 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:10 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3" returned: 0 in 0.861s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:10 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3, size 1024.00 MB, duration 4.45 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:08:10 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Converted 1024.00 MB image at 230.04 MB/s Apr 29 09:08:10 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa is being set with open permissions: ugo+rw Apr 29 09:08:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:10 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa Apr 29 09:08:10 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:11 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa" returned: 0 in 0.568s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-e7aa9d76-659a-481b-aab5-3fd3bc3036fa" released by "_copy_volume_from_snapshot" :: held 7.360s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-quobyte-461cb599-ec4b-465c-bbe7-de7aff2c9062" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-461cb599-ec4b-465c-bbe7-de7aff2c9062" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Deleting offline snapshot 461cb599-ec4b-465c-bbe7-de7aff2c9062 of volume 9cc1ac3f-f5dd-470c-9e37-a997f2378af3 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:08:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] snapshot_file for this snap is: volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:08:11 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d476ef-a499-4730-9c45-a3e8a32eea6d]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:11 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 Apr 29 09:08:11 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:11 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062" returned: 0 in 0.675s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:12 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:08:12 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb767251-7d93-4886-9974-180ea86df05d]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:12 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 Apr 29 09:08:12 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:12 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:UPDATE=64,cinder:SELECT=46,cinder:INSERT=16,cinder:DELETE=2 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:08:12 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3" returned: 0 in 0.686s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:12 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 Apr 29 09:08:12 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:13 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062" returned: 0 in 0.656s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:13 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062 Apr 29 09:08:13 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:13 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3.461cb599-ec4b-465c-bbe7-de7aff2c9062" returned: 0 in 0.560s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:13 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-461cb599-ec4b-465c-bbe7-de7aff2c9062" released by "_delete_snapshot" :: held 2.657s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.526s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2f6099-3d21-417b-96c1-82a51b40dbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa', 'volume_size': 1, 'source_volid': '9cc1ac3f-f5dd-470c-9e37-a997f2378af3', 'source_volstatus': 'available'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e11f38-5eb5-42cc-bb92-7c5408b9d752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:14 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Volume volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa (e7aa9d76-659a-481b-aab5-3fd3bc3036fa): created successfully Apr 29 09:08:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e11f38-5eb5-42cc-bb92-7c5408b9d752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Flow 'volume_create_manager' (51bbcbec-09e8-4628-a39c-f6a6482105be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:14 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-875c2f64-9ede-4b60-af49-2496d09d06ea tempest-VolumeDependencyTests-710706439 None] Created volume successfully. Apr 29 09:08:14 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-9cc1ac3f-f5dd-470c-9e37-a997f2378af3-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:14 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Lock "cinder-9cc1ac3f-f5dd-470c-9e37-a997f2378af3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:14 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-quobyte-9cc1ac3f-f5dd-470c-9e37-a997f2378af3" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:14 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-9cc1ac3f-f5dd-470c-9e37-a997f2378af3" acquired by "delete_volume" :: waited 0.013s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:14 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38a992f-e64f-4d82-95a8-ea9465fb0947]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:14 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 Apr 29 09:08:14 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:15 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3" returned: 0 in 0.671s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:15 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3 Apr 29 09:08:15 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:15 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9cc1ac3f-f5dd-470c-9e37-a997f2378af3" returned: 0 in 0.568s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-9cc1ac3f-f5dd-470c-9e37-a997f2378af3" released by "delete_volume" :: held 1.291s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:15 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Created reservations ['29228ded-0acc-4221-9885-beb228738be8', '7775a84d-aa70-4ed2-9515-ed962ebc0960', '9025b235-17f2-448c-aca3-bf0423271750', 'c539cbb7-7beb-497f-892d-e1b79bd9882e'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:15 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:15 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:08:15 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:16 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.567s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:16 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:16 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Deleted volume successfully. Apr 29 09:08:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-34ecac63-b209-41db-a051-a9b45d5ef3a2 tempest-VolumeDependencyTests-710706439 None] Lock "cinder-9cc1ac3f-f5dd-470c-9e37-a997f2378af3-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-e7aa9d76-659a-481b-aab5-3fd3bc3036fa-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Lock "cinder-e7aa9d76-659a-481b-aab5-3fd3bc3036fa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-quobyte-e7aa9d76-659a-481b-aab5-3fd3bc3036fa" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-e7aa9d76-659a-481b-aab5-3fd3bc3036fa" acquired by "delete_volume" :: waited 0.014s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:16 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eb4a02-46fe-41d8-848c-ea1b2c409ff1]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:16 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa Apr 29 09:08:16 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:17 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa" returned: 0 in 0.675s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:17 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa Apr 29 09:08:17 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:17 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e7aa9d76-659a-481b-aab5-3fd3bc3036fa" returned: 0 in 0.579s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-e7aa9d76-659a-481b-aab5-3fd3bc3036fa" released by "delete_volume" :: held 1.291s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:17 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Created reservations ['e9442d7c-22e1-4d0a-800c-e9c8bd38a318', '8158b51e-9263-4842-b4db-f09ccb5488b8', '3b8f0033-665a-482e-af00-9f04a1cfae90', '17ee099e-bdae-4386-b7f5-118f17dc4591'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:18 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:08:18 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:18 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.584s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:18 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Deleted volume successfully. Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-437b6bea-aa9c-4285-b6fb-d6329e3de2fc tempest-VolumeDependencyTests-710706439 None] Lock "cinder-e7aa9d76-659a-481b-aab5-3fd3bc3036fa-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-e0e6a37e-85ce-4c4c-97bc-82f282812b39-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Lock "cinder-e0e6a37e-85ce-4c4c-97bc-82f282812b39-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Acquiring lock "cinder-quobyte-e0e6a37e-85ce-4c4c-97bc-82f282812b39" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-e0e6a37e-85ce-4c4c-97bc-82f282812b39" acquired by "delete_volume" :: waited 0.015s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[9004c1a3-264f-4cc3-9be5-cd77bc357c40]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:19 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39 Apr 29 09:08:19 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:19 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39" returned: 0 in 0.713s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:19 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39 Apr 29 09:08:19 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:20 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e0e6a37e-85ce-4c4c-97bc-82f282812b39" returned: 0 in 0.601s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Lock "cinder-quobyte-e0e6a37e-85ce-4c4c-97bc-82f282812b39" released by "delete_volume" :: held 1.353s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:20 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Created reservations ['f9562d2f-01d2-4392-b6fd-899450352f57', '8004c2fd-1679-4cc6-8e35-27fd92baac5c', '0a15cebe-0335-4f0e-8d92-76f50850528b', '145cd61d-933d-45c0-aa0a-9781b2f25960'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:20 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:08:20 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:20 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.594s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:20 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:20 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Deleted volume successfully. Apr 29 09:08:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-97952233-56dd-461f-9ad6-b33e5b129b0e tempest-VolumeDependencyTests-710706439 None] Lock "cinder-e0e6a37e-85ce-4c4c-97bc-82f282812b39-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Flow 'volume_create_manager' (31512d91-d6be-4060-adca-baa5576986e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7585c1-8354-475b-9cd1-c9135261e35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7585c1-8354-475b-9cd1-c9135261e35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3810230-2c18-4702-a33d-d849ff4ac141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9daffedc3943cba703520faba109d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:24Z,use_quota=True,user_id='b582567670704ead9d5eb41f79a6737f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6a29d4-5bbf-44c8-a40a-88949c934f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6a29d4-5bbf-44c8-a40a-88949c934f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5aa838f-2179-42fc-8690-5080eeef7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5aa838f-2179-42fc-8690-5080eeef7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3810230-2c18-4702-a33d-d849ff4ac141', 'volume_name': 'volume-f3810230-2c18-4702-a33d-d849ff4ac141', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284387df-e2fe-4a0a-838f-74ca29622b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284387df-e2fe-4a0a-838f-74ca29622b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844d1a08-fec9-4bc8-a86c-33f65f194165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:23 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Volume f3810230-2c18-4702-a33d-d849ff4ac141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3810230-2c18-4702-a33d-d849ff4ac141', 'volume_size': 1} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3810230-2c18-4702-a33d-d849ff4ac141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9daffedc3943cba703520faba109d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:24Z,use_quota=True,user_id='b582567670704ead9d5eb41f79a6737f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Creating volume f3810230-2c18-4702-a33d-d849ff4ac141 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:23 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:08:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f3810230-2c18-4702-a33d-d849ff4ac141 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:23 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f3810230-2c18-4702-a33d-d849ff4ac141 1073741824 Apr 29 09:08:23 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:24 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f3810230-2c18-4702-a33d-d849ff4ac141 1073741824" returned: 0 in 0.885s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f3810230-2c18-4702-a33d-d849ff4ac141 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:24 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f3810230-2c18-4702-a33d-d849ff4ac141 Apr 29 09:08:24 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:25 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f3810230-2c18-4702-a33d-d849ff4ac141" returned: 0 in 0.609s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844d1a08-fec9-4bc8-a86c-33f65f194165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3810230-2c18-4702-a33d-d849ff4ac141', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28dd53f6-7975-4840-8890-122d2dd7e3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:25 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Volume volume-f3810230-2c18-4702-a33d-d849ff4ac141 (f3810230-2c18-4702-a33d-d849ff4ac141): created successfully Apr 29 09:08:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28dd53f6-7975-4840-8890-122d2dd7e3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Flow 'volume_create_manager' (31512d91-d6be-4060-adca-baa5576986e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:25 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-04af3f9a-ead7-4edf-979c-682d9218f5c4 tempest-CinderUnicodeTest-390548004 None] Created volume successfully. Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Flow 'volume_create_manager' (7f9cacb9-d1c1-4b6c-9a57-7acb8bd7e0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce75cb4-2244-4c20-8b5b-e992d35bb926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce75cb4-2244-4c20-8b5b-e992d35bb926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-774269900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a058ec2-57b7-492d-b68e-9fc15fd8a15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9daffedc3943cba703520faba109d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:26Z,use_quota=True,user_id='b582567670704ead9d5eb41f79a6737f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5374d8b2-fcef-4de2-b0cf-156058a8367f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5374d8b2-fcef-4de2-b0cf-156058a8367f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d495ce-e1f0-4dd4-9e89-d36d55338cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d495ce-e1f0-4dd4-9e89-d36d55338cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a058ec2-57b7-492d-b68e-9fc15fd8a15a', 'volume_name': 'volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104976b7-f0a2-41e1-8cb1-5e9b527781f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104976b7-f0a2-41e1-8cb1-5e9b527781f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c09791-c3e1-413a-aba6-1333e40dc502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:26 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Volume 4a058ec2-57b7-492d-b68e-9fc15fd8a15a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a', 'volume_size': 1} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-774269900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a058ec2-57b7-492d-b68e-9fc15fd8a15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9daffedc3943cba703520faba109d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:26Z,use_quota=True,user_id='b582567670704ead9d5eb41f79a6737f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Creating volume 4a058ec2-57b7-492d-b68e-9fc15fd8a15a {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:26 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:08:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:26 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a 1073741824 Apr 29 09:08:26 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:27 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a 1073741824" returned: 0 in 0.901s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:27 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a Apr 29 09:08:27 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:28 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a" returned: 0 in 0.751s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c09791-c3e1-413a-aba6-1333e40dc502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1571a8c2-b790-4074-b290-0bb10244a4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:28 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Volume volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a (4a058ec2-57b7-492d-b68e-9fc15fd8a15a): created successfully Apr 29 09:08:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1571a8c2-b790-4074-b290-0bb10244a4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Flow 'volume_create_manager' (7f9cacb9-d1c1-4b6c-9a57-7acb8bd7e0fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:28 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f3e5ae8b-7a91-4c51-b6e1-46eb406a9923 tempest-CinderUnicodeTest-390548004 None] Created volume successfully. Apr 29 09:08:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] Creating offline snapshot b63987b9-d795-4ebf-a2dc-a05ec6766aae of volume 4a058ec2-57b7-492d-b68e-9fc15fd8a15a {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:08:28 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdba5b7-49e8-4ea7-aea8-39e5f7d3fa85]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:28 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a Apr 29 09:08:28 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:29 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a" returned: 0 in 0.748s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:29 devstack sudo[93135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae 1G Apr 29 09:08:29 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:30 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae 1G" returned: 0 in 0.867s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:30 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae Apr 29 09:08:30 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:31 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae" returned: 0 in 0.730s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:31 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae is being set with open permissions: ugo+rw Apr 29 09:08:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:31 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae Apr 29 09:08:31 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:31 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae" returned: 0 in 0.620s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:31 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.info Apr 29 09:08:31 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:32 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.info" returned: 0 in 0.751s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:32 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.info is being set with open permissions: ugo+rw Apr 29 09:08:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:32 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.info Apr 29 09:08:32 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:33 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.info" returned: 0 in 0.675s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.478s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:33 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-1b35d80e-75e3-4321-bd1c-b0aca62f6885 tempest-CinderUnicodeTest-390548004 None] Create snapshot completed successfully Apr 29 09:08:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Acquiring lock "cinder-b63987b9-d795-4ebf-a2dc-a05ec6766aae-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Lock "cinder-b63987b9-d795-4ebf-a2dc-a05ec6766aae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Acquiring lock "cinder-quobyte-4a058ec2-57b7-492d-b68e-9fc15fd8a15a" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Lock "cinder-quobyte-4a058ec2-57b7-492d-b68e-9fc15fd8a15a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Acquiring lock "cinder-quobyte-b63987b9-d795-4ebf-a2dc-a05ec6766aae" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Lock "cinder-quobyte-b63987b9-d795-4ebf-a2dc-a05ec6766aae" acquired by "_delete_snapshot" :: waited 0.081s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Deleting offline snapshot b63987b9-d795-4ebf-a2dc-a05ec6766aae of volume 4a058ec2-57b7-492d-b68e-9fc15fd8a15a {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:08:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] snapshot_file for this snap is: volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:08:34 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[576b46ad-d32f-490c-a958-842144b69b1e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:34 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae Apr 29 09:08:34 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:35 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae" returned: 0 in 0.788s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:08:35 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccfb357-64ec-4092-a307-5ae63f45895f]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:35 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a Apr 29 09:08:35 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:35 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a" returned: 0 in 0.704s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:35 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae Apr 29 09:08:35 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:36 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae" returned: 0 in 0.703s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:36 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae Apr 29 09:08:36 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:37 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a.b63987b9-d795-4ebf-a2dc-a05ec6766aae" returned: 0 in 0.600s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Lock "cinder-quobyte-b63987b9-d795-4ebf-a2dc-a05ec6766aae" released by "_delete_snapshot" :: held 2.900s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Lock "cinder-quobyte-4a058ec2-57b7-492d-b68e-9fc15fd8a15a" released by "delete_snapshot" :: held 2.990s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:37 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Created reservations ['3fb52ac3-f0fe-4430-958e-65f1ef909e35', 'dde792e6-23b4-484b-bebb-39b2557a62e2', 'e1b6ac5b-e086-4219-bd8a-f6025f91d831', '70d5ee60-d0c2-4b65-9c78-d898ffdc5177'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:37 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Delete snapshot completed successfully. Apr 29 09:08:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-b32278a4-0261-46bc-ac0a-3bf2423741d1 tempest-CinderUnicodeTest-390548004 None] Lock "cinder-b63987b9-d795-4ebf-a2dc-a05ec6766aae-delete_snapshot" released by "delete_snapshot" :: held 3.146s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Acquiring lock "cinder-4a058ec2-57b7-492d-b68e-9fc15fd8a15a-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Lock "cinder-4a058ec2-57b7-492d-b68e-9fc15fd8a15a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Acquiring lock "cinder-quobyte-4a058ec2-57b7-492d-b68e-9fc15fd8a15a" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Lock "cinder-quobyte-4a058ec2-57b7-492d-b68e-9fc15fd8a15a" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:37 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7496df5-1623-41c3-a7aa-891ce47f810b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:37 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a Apr 29 09:08:37 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:38 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a" returned: 0 in 0.867s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:38 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a Apr 29 09:08:38 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:38 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-4a058ec2-57b7-492d-b68e-9fc15fd8a15a" returned: 0 in 0.635s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Lock "cinder-quobyte-4a058ec2-57b7-492d-b68e-9fc15fd8a15a" released by "delete_volume" :: held 1.558s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:38 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Created reservations ['1aff31fc-5e61-4cf6-9a75-fec6d96dec03', 'dc39927b-17c7-4453-9e65-9eb04b409779', 'f36fa433-ef23-42c2-84eb-b1bcdc5f77b4', 'df3b673e-5a33-4819-a9bf-e23ad9ded10a'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:39 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:08:39 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Acquiring lock "cinder-f3810230-2c18-4702-a33d-d849ff4ac141-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Lock "cinder-f3810230-2c18-4702-a33d-d849ff4ac141-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Acquiring lock "cinder-quobyte-f3810230-2c18-4702-a33d-d849ff4ac141" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Lock "cinder-quobyte-f3810230-2c18-4702-a33d-d849ff4ac141" acquired by "delete_volume" :: waited 0.015s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b93d6c-ed4e-477c-8874-8cfe168dec1c]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f3810230-2c18-4702-a33d-d849ff4ac141 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:39 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f3810230-2c18-4702-a33d-d849ff4ac141 Apr 29 09:08:39 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:39 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.711s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:39 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Deleted volume successfully. Apr 29 09:08:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-596ab7fe-1601-407e-a2c0-038a9ac710b0 tempest-CinderUnicodeTest-390548004 None] Lock "cinder-4a058ec2-57b7-492d-b68e-9fc15fd8a15a-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:40 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f3810230-2c18-4702-a33d-d849ff4ac141" returned: 0 in 0.798s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f3810230-2c18-4702-a33d-d849ff4ac141 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:40 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f3810230-2c18-4702-a33d-d849ff4ac141 Apr 29 09:08:40 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:41 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f3810230-2c18-4702-a33d-d849ff4ac141" returned: 0 in 0.696s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Lock "cinder-quobyte-f3810230-2c18-4702-a33d-d849ff4ac141" released by "delete_volume" :: held 1.535s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:41 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Created reservations ['df6442b7-7ba8-4861-b401-3df298f2afbc', '4763254d-84f1-4136-9b7d-5eb455e778e4', '9e27a1d3-dab2-41e1-ae70-9af4012c4eb0', '68305388-5b5a-439f-8701-fc9d0de2cb42'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:41 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:08:41 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:41 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.584s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:41 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:41 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Deleted volume successfully. Apr 29 09:08:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7df0c67f-d809-495e-ae23-5f5a9b60cddd tempest-CinderUnicodeTest-390548004 None] Lock "cinder-f3810230-2c18-4702-a33d-d849ff4ac141-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:51 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:UPDATE=57,cinder:SELECT=42,cinder:INSERT=12,cinder:DELETE=4 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:08:51 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:DELETE=6,cinder:SELECT=52,cinder:INSERT=19,cinder:UPDATE=76 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:08:52 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:08:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Flow 'volume_create_manager' (c5d219a1-53d6-46a0-bd7d-18f79d0e2d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ea424e-b44a-46f2-b997-ab7572759ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ea424e-b44a-46f2-b997-ab7572759ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1755680217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9685af0c-729e-4360-b411-d228b6054dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35b2c83cf89425a996daad6c384e179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:53Z,use_quota=True,user_id='1c9bbfd9dee54edebe8fed51cf3fc835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36571552-e847-4bea-b172-26d869a6dee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36571552-e847-4bea-b172-26d869a6dee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661e97a1-744a-4ee4-a7db-ae12f9cfe537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:52 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661e97a1-744a-4ee4-a7db-ae12f9cfe537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9685af0c-729e-4360-b411-d228b6054dca', 'volume_name': 'volume-9685af0c-729e-4360-b411-d228b6054dca', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3e46af-5361-407f-99fc-11874e51db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3e46af-5361-407f-99fc-11874e51db62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ceeb878-c752-4692-9c05-fca6e479aba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:53 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume 9685af0c-729e-4360-b411-d228b6054dca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9685af0c-729e-4360-b411-d228b6054dca', 'volume_size': 1} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1755680217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9685af0c-729e-4360-b411-d228b6054dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35b2c83cf89425a996daad6c384e179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:53Z,use_quota=True,user_id='1c9bbfd9dee54edebe8fed51cf3fc835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Creating volume 9685af0c-729e-4360-b411-d228b6054dca {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:53 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:53 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca 1073741824 Apr 29 09:08:53 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Flow 'volume_create_manager' (00bfde9d-3d89-4b9a-bd9a-cdaa2bad87d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eedd05a9-6eb6-431d-8861-2a7721631554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eedd05a9-6eb6-431d-8861-2a7721631554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-66519870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7a1c9e-e1f9-484b-8156-9b817159faeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5423d1a7de4782ae9db5ff70efc133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:54Z,use_quota=True,user_id='ea3a082d769b4cf2847bcb0ab38f955d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4f00c6-c6ca-4626-baa8-b952a3259157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4f00c6-c6ca-4626-baa8-b952a3259157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd00b2c-e4b0-4086-8265-757767a4a9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd00b2c-e4b0-4086-8265-757767a4a9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7a1c9e-e1f9-484b-8156-9b817159faeb', 'volume_name': 'volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2106acb7-5c36-4d7c-8003-fa75f97a138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2106acb7-5c36-4d7c-8003-fa75f97a138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93236147-bc12-4dca-bde9-afe9af6af5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:53 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Volume ea7a1c9e-e1f9-484b-8156-9b817159faeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb', 'volume_size': 1} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Flow 'volume_create_manager' (61b6743b-41af-450d-8d6a-a0cb7e244334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8657bb-3e41-4055-b6cf-4b42e8108f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8657bb-3e41-4055-b6cf-4b42e8108f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-519060053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a28aebc-992d-4858-a7e9-1d96fa8228c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8368b08f7a4d4087b05c7a7441cf6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:54Z,use_quota=True,user_id='fb18202f8a044d29bbf094155c2637cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264fe7aa-e495-4854-b278-6332feaac1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264fe7aa-e495-4854-b278-6332feaac1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1effed-c553-448b-908f-8407872be61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1effed-c553-448b-908f-8407872be61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a28aebc-992d-4858-a7e9-1d96fa8228c3', 'volume_name': 'volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759b9155-56d4-4752-b03b-e2f621aed061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759b9155-56d4-4752-b03b-e2f621aed061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d08fd5e-22c9-4311-9ba2-baf6d97547cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:53 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Volume 2a28aebc-992d-4858-a7e9-1d96fa8228c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3', 'volume_size': 1} Apr 29 09:08:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Flow 'volume_create_manager' (8f0ed6d9-2da1-42b1-bc15-c35e46442218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ba6a03-e5d3-4b5c-b9a9-84769e7f8d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ba6a03-e5d3-4b5c-b9a9-84769e7f8d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1744305543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6640956b-fc93-498d-a5c4-5b39b12c9ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8368b08f7a4d4087b05c7a7441cf6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:54Z,use_quota=True,user_id='fb18202f8a044d29bbf094155c2637cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b775ba4-901b-41ab-89b8-3fd7652e48d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b775ba4-901b-41ab-89b8-3fd7652e48d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e69bf4-f411-4a8c-8a61-5d5165424ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e69bf4-f411-4a8c-8a61-5d5165424ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6640956b-fc93-498d-a5c4-5b39b12c9ebb', 'volume_name': 'volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e3f687-3dd0-40fc-aabe-608101883c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e3f687-3dd0-40fc-aabe-608101883c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a001056-242c-45a7-b666-244bc48bb86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Volume 6640956b-fc93-498d-a5c4-5b39b12c9ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb', 'volume_size': 1} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:54 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca 1073741824" returned: 0 in 1.284s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:54 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca Apr 29 09:08:54 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Flow 'volume_create_manager' (4b5952c6-7abd-4145-aa9e-e9d412e7e155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c17319-c160-431e-947d-30b8a0c6c286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c17319-c160-431e-947d-30b8a0c6c286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-485351781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae9cbab-6549-4276-b687-3eeeeb333365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8368b08f7a4d4087b05c7a7441cf6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:55Z,use_quota=True,user_id='fb18202f8a044d29bbf094155c2637cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6284cf2-4479-4af2-ac6e-3e6e64b855c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6284cf2-4479-4af2-ac6e-3e6e64b855c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eaee1fc-0909-45cc-91da-d9e8c0106761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eaee1fc-0909-45cc-91da-d9e8c0106761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae9cbab-6549-4276-b687-3eeeeb333365', 'volume_name': 'volume-6ae9cbab-6549-4276-b687-3eeeeb333365', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fc4611-2c03-4e79-a24f-e5a9e82351d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fc4611-2c03-4e79-a24f-e5a9e82351d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934979a7-6301-411c-9b21-bb79861c5d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Volume 6ae9cbab-6549-4276-b687-3eeeeb333365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae9cbab-6549-4276-b687-3eeeeb333365', 'volume_size': 1} Apr 29 09:08:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Flow 'volume_create_manager' (8187b22a-973a-43ec-8744-4abe749c5b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74e088f-04eb-41a0-bc16-e38a35de2241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74e088f-04eb-41a0-bc16-e38a35de2241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-998790770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe4814a-266b-4502-80e7-dcaa011c1c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8368b08f7a4d4087b05c7a7441cf6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:55Z,use_quota=True,user_id='fb18202f8a044d29bbf094155c2637cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6370b7-f932-4c01-a806-405a44a49023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6370b7-f932-4c01-a806-405a44a49023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5389dd77-003e-4437-811a-7f9872b3a78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5389dd77-003e-4437-811a-7f9872b3a78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe4814a-266b-4502-80e7-dcaa011c1c00', 'volume_name': 'volume-9fe4814a-266b-4502-80e7-dcaa011c1c00', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4d89da-85b5-4894-9910-c2a0fb14c778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4d89da-85b5-4894-9910-c2a0fb14c778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a860e7c-2f11-4b46-9f37-fba8f4ba117e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:55 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Volume 9fe4814a-266b-4502-80e7-dcaa011c1c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe4814a-266b-4502-80e7-dcaa011c1c00', 'volume_size': 1} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:55 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca" returned: 0 in 0.917s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.571s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-66519870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7a1c9e-e1f9-484b-8156-9b817159faeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5423d1a7de4782ae9db5ff70efc133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:54Z,use_quota=True,user_id='ea3a082d769b4cf2847bcb0ab38f955d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Creating volume ea7a1c9e-e1f9-484b-8156-9b817159faeb {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:55 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ceeb878-c752-4692-9c05-fca6e479aba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9685af0c-729e-4360-b411-d228b6054dca', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:55 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb 1073741824 Apr 29 09:08:55 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176fe078-7e91-4283-a2cb-87b1a5504219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:55 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume volume-9685af0c-729e-4360-b411-d228b6054dca (9685af0c-729e-4360-b411-d228b6054dca): created successfully Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176fe078-7e91-4283-a2cb-87b1a5504219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Flow 'volume_create_manager' (c5d219a1-53d6-46a0-bd7d-18f79d0e2d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:55 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-07cf6d22-6b3b-4a58-a448-9c65fd1e934d tempest-CreateVolumesFromSnapshotTest-40906556 None] Created volume successfully. Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Flow 'volume_create_manager' (091ebd19-d2bd-49cf-b397-510363ad36ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b698d3-5242-4810-8477-d11965dce095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b698d3-5242-4810-8477-d11965dce095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1763921422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ec1c87-fec0-4214-ac58-1227f8f0ed91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8368b08f7a4d4087b05c7a7441cf6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:56Z,use_quota=True,user_id='fb18202f8a044d29bbf094155c2637cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ecbfe9-41ba-4e50-98cb-5f9566a8408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ecbfe9-41ba-4e50-98cb-5f9566a8408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06c4582-ba14-4eca-8bc9-a3617a792360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06c4582-ba14-4eca-8bc9-a3617a792360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5ec1c87-fec0-4214-ac58-1227f8f0ed91', 'volume_name': 'volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c88683-d03d-4449-911f-7d635bb9d1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c88683-d03d-4449-911f-7d635bb9d1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f28d47-a051-4972-b087-0893c32a7631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:55 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Volume f5ec1c87-fec0-4214-ac58-1227f8f0ed91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91', 'volume_size': 1} Apr 29 09:08:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:56 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb 1073741824" returned: 0 in 0.973s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:56 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb Apr 29 09:08:56 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:57 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb" returned: 0 in 0.750s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.116s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-519060053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a28aebc-992d-4858-a7e9-1d96fa8228c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8368b08f7a4d4087b05c7a7441cf6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:54Z,use_quota=True,user_id='fb18202f8a044d29bbf094155c2637cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Creating volume 2a28aebc-992d-4858-a7e9-1d96fa8228c3 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:57 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93236147-bc12-4dca-bde9-afe9af6af5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:57 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3 1073741824 Apr 29 09:08:57 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4d6b43-4322-4d03-896a-26a698c8f43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:57 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Volume volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb (ea7a1c9e-e1f9-484b-8156-9b817159faeb): created successfully Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4d6b43-4322-4d03-896a-26a698c8f43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Flow 'volume_create_manager' (00bfde9d-3d89-4b9a-bd9a-cdaa2bad87d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:57 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-9f312cf7-b914-454d-9b12-eebaf4a2bf4c tempest-VolumeDependencyTests-291119355 None] Created volume successfully. Apr 29 09:08:58 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3 1073741824" returned: 0 in 0.966s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:58 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3 Apr 29 09:08:58 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:58 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3" returned: 0 in 0.587s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.433s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1744305543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6640956b-fc93-498d-a5c4-5b39b12c9ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8368b08f7a4d4087b05c7a7441cf6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:54Z,use_quota=True,user_id='fb18202f8a044d29bbf094155c2637cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Creating volume 6640956b-fc93-498d-a5c4-5b39b12c9ebb {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:58 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d08fd5e-22c9-4311-9ba2-baf6d97547cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48710852-dd55-4019-b60e-fe6cc66fed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:58 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb 1073741824 Apr 29 09:08:58 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:58 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Volume volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3 (2a28aebc-992d-4858-a7e9-1d96fa8228c3): created successfully Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48710852-dd55-4019-b60e-fe6cc66fed89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:58 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Flow 'volume_create_manager' (61b6743b-41af-450d-8d6a-a0cb7e244334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:58 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-4fcdf28f-a701-44e1-b9e2-0f9840dc3c89 tempest-CreateVolumesFromImageTest-1467833295 None] Created volume successfully. Apr 29 09:08:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:08:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:59 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:08:59 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:59 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb 1073741824" returned: 0 in 1.026s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:59 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb Apr 29 09:08:59 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:00 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.681s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:00 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb" returned: 0 in 0.684s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.684s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-485351781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae9cbab-6549-4276-b687-3eeeeb333365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8368b08f7a4d4087b05c7a7441cf6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:55Z,use_quota=True,user_id='fb18202f8a044d29bbf094155c2637cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Creating volume 6ae9cbab-6549-4276-b687-3eeeeb333365 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:00 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ae9cbab-6549-4276-b687-3eeeeb333365 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a001056-242c-45a7-b666-244bc48bb86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:00 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ae9cbab-6549-4276-b687-3eeeeb333365 1073741824 Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acf6979-4a8d-4451-8b8e-a5375803e11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:00 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:00 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Volume volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb (6640956b-fc93-498d-a5c4-5b39b12c9ebb): created successfully Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acf6979-4a8d-4451-8b8e-a5375803e11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:00 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Flow 'volume_create_manager' (8f0ed6d9-2da1-42b1-bc15-c35e46442218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:00 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-04769d19-77d8-4670-93ea-f96cd04de432 tempest-CreateVolumesFromImageTest-1467833295 None] Created volume successfully. Apr 29 09:09:01 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ae9cbab-6549-4276-b687-3eeeeb333365 1073741824" returned: 0 in 0.943s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ae9cbab-6549-4276-b687-3eeeeb333365 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:01 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ae9cbab-6549-4276-b687-3eeeeb333365 Apr 29 09:09:01 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:02 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ae9cbab-6549-4276-b687-3eeeeb333365" returned: 0 in 0.730s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.948s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-998790770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe4814a-266b-4502-80e7-dcaa011c1c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8368b08f7a4d4087b05c7a7441cf6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:55Z,use_quota=True,user_id='fb18202f8a044d29bbf094155c2637cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Creating volume 9fe4814a-266b-4502-80e7-dcaa011c1c00 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:02 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9fe4814a-266b-4502-80e7-dcaa011c1c00 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:02 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9fe4814a-266b-4502-80e7-dcaa011c1c00 1073741824 Apr 29 09:09:02 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934979a7-6301-411c-9b21-bb79861c5d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae9cbab-6549-4276-b687-3eeeeb333365', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67d3fb5-54b8-41ef-8134-0adbb9bf4e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:02 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Volume volume-6ae9cbab-6549-4276-b687-3eeeeb333365 (6ae9cbab-6549-4276-b687-3eeeeb333365): created successfully Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67d3fb5-54b8-41ef-8134-0adbb9bf4e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:02 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Flow 'volume_create_manager' (4b5952c6-7abd-4145-aa9e-e9d412e7e155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:02 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-30f2321d-dab1-4195-86f8-be28601dcea4 tempest-CreateVolumesFromImageTest-1467833295 None] Created volume successfully. Apr 29 09:09:03 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9fe4814a-266b-4502-80e7-dcaa011c1c00 1073741824" returned: 0 in 0.865s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9fe4814a-266b-4502-80e7-dcaa011c1c00 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:03 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9fe4814a-266b-4502-80e7-dcaa011c1c00 Apr 29 09:09:03 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:03 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9fe4814a-266b-4502-80e7-dcaa011c1c00" returned: 0 in 0.675s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.074s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1763921422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ec1c87-fec0-4214-ac58-1227f8f0ed91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8368b08f7a4d4087b05c7a7441cf6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:56Z,use_quota=True,user_id='fb18202f8a044d29bbf094155c2637cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Creating volume f5ec1c87-fec0-4214-ac58-1227f8f0ed91 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:03 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:03 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91 1073741824 Apr 29 09:09:03 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a860e7c-2f11-4b46-9f37-fba8f4ba117e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe4814a-266b-4502-80e7-dcaa011c1c00', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a02b4d8-fffe-4b7b-99c4-071367d570d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:03 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Volume volume-9fe4814a-266b-4502-80e7-dcaa011c1c00 (9fe4814a-266b-4502-80e7-dcaa011c1c00): created successfully Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a02b4d8-fffe-4b7b-99c4-071367d570d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Flow 'volume_create_manager' (8187b22a-973a-43ec-8744-4abe749c5b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:03 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f5e68662-ba3f-45b0-9270-9719fe8d2070 tempest-CreateVolumesFromImageTest-1467833295 None] Created volume successfully. Apr 29 09:09:04 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91 1073741824" returned: 0 in 1.085s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:04 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91 Apr 29 09:09:04 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:05 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91" returned: 0 in 0.633s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.208s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:05 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] Creating offline snapshot c9448bcf-aec2-4458-8cad-3067b5256114 of volume 9685af0c-729e-4360-b411-d228b6054dca {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:09:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f28d47-a051-4972-b087-0893c32a7631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a350b72a-fa24-4ac7-83de-dbeec28850ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:05 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c45c9fd-289c-4674-a30d-35e2ceb77917]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:05 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Volume volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91 (f5ec1c87-fec0-4214-ac58-1227f8f0ed91): created successfully Apr 29 09:09:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a350b72a-fa24-4ac7-83de-dbeec28850ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Flow 'volume_create_manager' (091ebd19-d2bd-49cf-b397-510363ad36ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:05 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-6a0f3350-7f3f-4670-9538-b9b25d45b95b tempest-CreateVolumesFromImageTest-1467833295 None] Created volume successfully. Apr 29 09:09:05 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca Apr 29 09:09:05 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:06 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca" returned: 0 in 0.856s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:06 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 1G Apr 29 09:09:06 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "cinder-f5ec1c87-fec0-4214-ac58-1227f8f0ed91-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-f5ec1c87-fec0-4214-ac58-1227f8f0ed91-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "cinder-quobyte-f5ec1c87-fec0-4214-ac58-1227f8f0ed91" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-quobyte-f5ec1c87-fec0-4214-ac58-1227f8f0ed91" acquired by "delete_volume" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:06 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf02aa7-6aef-43d1-a265-2b5f213be112]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:06 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91 Apr 29 09:09:06 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:07 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 1G" returned: 0 in 1.017s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9685af0c-729e-4360-b411-d228b6054dca -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:07 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9685af0c-729e-4360-b411-d228b6054dca -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 Apr 29 09:09:07 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:07 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91" returned: 0 in 0.944s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:07 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91 Apr 29 09:09:07 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:08 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9685af0c-729e-4360-b411-d228b6054dca -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114" returned: 0 in 0.773s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:08 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 is being set with open permissions: ugo+rw Apr 29 09:09:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:08 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 Apr 29 09:09:08 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:08 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f5ec1c87-fec0-4214-ac58-1227f8f0ed91" returned: 0 in 0.661s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-quobyte-f5ec1c87-fec0-4214-ac58-1227f8f0ed91" released by "delete_volume" :: held 1.670s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:08 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Created reservations ['b1dbe33f-02d5-4bae-8b01-b9144a527861', 'baf05c8a-a26d-4524-a913-28cacc95ac84', '9dbfc3b9-ea92-4c49-95ec-da11234ae2e9', 'f3dec2b1-52f5-40da-8648-461b7dd1bb27'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:08 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:08 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:08 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:08 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "cinder-9fe4814a-266b-4502-80e7-dcaa011c1c00-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:09 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114" returned: 0 in 0.769s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-9fe4814a-266b-4502-80e7-dcaa011c1c00-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "cinder-quobyte-9fe4814a-266b-4502-80e7-dcaa011c1c00" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-quobyte-9fe4814a-266b-4502-80e7-dcaa011c1c00" acquired by "delete_volume" :: waited 0.024s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:09 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.info Apr 29 09:09:09 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba1c738-bea5-4305-839a-b8ef0213fbf2]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9fe4814a-266b-4502-80e7-dcaa011c1c00 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:09 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9fe4814a-266b-4502-80e7-dcaa011c1c00 Apr 29 09:09:09 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:09 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.874s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:09 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Deleted volume successfully. Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-da9bc704-6885-4640-b30c-18797687c7fc tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-f5ec1c87-fec0-4214-ac58-1227f8f0ed91-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:09 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.info" returned: 0 in 0.831s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:09 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.info is being set with open permissions: ugo+rw Apr 29 09:09:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:09 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.info Apr 29 09:09:09 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:10 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9fe4814a-266b-4502-80e7-dcaa011c1c00" returned: 0 in 0.826s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9fe4814a-266b-4502-80e7-dcaa011c1c00 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:10 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9fe4814a-266b-4502-80e7-dcaa011c1c00 Apr 29 09:09:10 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:10 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:10 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.info" returned: 0 in 0.836s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.228s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9fe4814a-266b-4502-80e7-dcaa011c1c00" returned: 0 in 0.762s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.708s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-quobyte-9fe4814a-266b-4502-80e7-dcaa011c1c00" released by "delete_volume" :: held 1.670s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] Creating offline snapshot 3a2487e8-f1bf-4f66-8d28-0db46e6ad256 of volume ea7a1c9e-e1f9-484b-8156-9b817159faeb {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:09:10 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e442e54f-a2c9-48b6-8bee-d1944d818f49 tempest-CreateVolumesFromSnapshotTest-40906556 None] Create snapshot completed successfully Apr 29 09:09:10 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[29754127-3e7f-4aed-a5ef-208f669a268b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:10 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Created reservations ['1b4daf58-abec-4983-93be-ebb867951314', 'dd489340-d27f-422f-948e-ebe350c85ba8', 'cd359fed-db46-4d27-be23-24e7765bf8f9', 'e79ea958-625f-4039-847a-4c24508c4713'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:11 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb Apr 29 09:09:11 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:11 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:11 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "cinder-6ae9cbab-6549-4276-b687-3eeeeb333365-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-6ae9cbab-6549-4276-b687-3eeeeb333365-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "cinder-quobyte-6ae9cbab-6549-4276-b687-3eeeeb333365" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-quobyte-6ae9cbab-6549-4276-b687-3eeeeb333365" acquired by "delete_volume" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c0509f-31cd-4d7f-81af-dd08b63532fa]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ae9cbab-6549-4276-b687-3eeeeb333365 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Flow 'volume_create_manager' (5c8891f1-e988-4d9c-a363-cf5f0ca48f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc641b82-62de-4ce1-a8b6-a4c7c6a9d9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:11 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ae9cbab-6549-4276-b687-3eeeeb333365 Apr 29 09:09:11 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:11 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc641b82-62de-4ce1-a8b6-a4c7c6a9d9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1595642290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a854e9bd-aaf5-46ea-a411-b22604bcec2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35b2c83cf89425a996daad6c384e179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:12Z,use_quota=True,user_id='1c9bbfd9dee54edebe8fed51cf3fc835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5e5f22-4f86-4cc4-bcd8-70fd36bade1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5e5f22-4f86-4cc4-bcd8-70fd36bade1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2596a443-57e7-4b03-8de0-6c0b30a40d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2596a443-57e7-4b03-8de0-6c0b30a40d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a854e9bd-aaf5-46ea-a411-b22604bcec2c', 'volume_name': 'volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:12 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252ba4e2-0177-4f1a-9a70-bcdd60c2af05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252ba4e2-0177-4f1a-9a70-bcdd60c2af05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2fdb3a-a80b-49af-8ba8-6d17c71919ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:12 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume a854e9bd-aaf5-46ea-a411-b22604bcec2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c', 'volume_size': 1} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.007s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:12 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Deleted volume successfully. Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f7fc81a7-1545-4b16-bd6c-056aae6e07dd tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-9fe4814a-266b-4502-80e7-dcaa011c1c00-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:12 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb" returned: 0 in 1.261s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:12 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 1G Apr 29 09:09:12 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Flow 'volume_create_manager' (d91a5631-4b90-4a5f-aeea-2ff7e8f107f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d8bfe7-3369-4858-9639-18771a3d4554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d8bfe7-3369-4858-9639-18771a3d4554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-944203804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765ad1ce-7dfc-4e4e-92db-93ffd2574c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35b2c83cf89425a996daad6c384e179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:13Z,use_quota=True,user_id='1c9bbfd9dee54edebe8fed51cf3fc835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e0d39d-b286-4630-a1a0-1082aa0842c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e0d39d-b286-4630-a1a0-1082aa0842c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a10ab0-7f0f-40d6-8416-01610af92ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a10ab0-7f0f-40d6-8416-01610af92ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765ad1ce-7dfc-4e4e-92db-93ffd2574c02', 'volume_name': 'volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213c3fa5-2b9b-401a-9eb6-dc4af500c2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213c3fa5-2b9b-401a-9eb6-dc4af500c2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911e959f-adb7-401f-b1b3-ba357fa21cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:12 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume 765ad1ce-7dfc-4e4e-92db-93ffd2574c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02', 'volume_size': 1} Apr 29 09:09:12 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Flow 'volume_create_manager' (93304733-0e83-460b-aad5-70265804770c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31dc2574-da10-4e1c-ba6b-55137d7b18e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31dc2574-da10-4e1c-ba6b-55137d7b18e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1820696345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6fe6fc-0e53-4259-b41d-ecfb333ca253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35b2c83cf89425a996daad6c384e179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:13Z,use_quota=True,user_id='1c9bbfd9dee54edebe8fed51cf3fc835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6878ae-dfb2-44fa-8fc4-7da21b11b2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6878ae-dfb2-44fa-8fc4-7da21b11b2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45cde2ff-3242-4e3a-bc04-cac63a46ebd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45cde2ff-3242-4e3a-bc04-cac63a46ebd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b6fe6fc-0e53-4259-b41d-ecfb333ca253', 'volume_name': 'volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc03abb-263f-4e5b-ade7-abb9c530324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc03abb-263f-4e5b-ade7-abb9c530324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5df8acd-e48a-4d6a-a708-4dc09104c40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:13 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume 2b6fe6fc-0e53-4259-b41d-ecfb333ca253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253', 'volume_size': 1} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:13 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 1G" returned: 0 in 1.188s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:13 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ae9cbab-6549-4276-b687-3eeeeb333365" returned: 0 in 1.732s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:13 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ae9cbab-6549-4276-b687-3eeeeb333365 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:13 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 Apr 29 09:09:13 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:13 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ae9cbab-6549-4276-b687-3eeeeb333365 Apr 29 09:09:13 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Flow 'volume_create_manager' (b092c671-5978-415c-ab6b-6271b34b441b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bed0806-7a65-4d97-a81a-372a11471a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bed0806-7a65-4d97-a81a-372a11471a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-367443504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef0e99c-b489-4ce5-b255-0d866f877af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35b2c83cf89425a996daad6c384e179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:14Z,use_quota=True,user_id='1c9bbfd9dee54edebe8fed51cf3fc835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8f3c02-7da4-43e8-8092-43152b515c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8f3c02-7da4-43e8-8092-43152b515c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf13078-028a-4db9-9c05-da51d0c9671a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf13078-028a-4db9-9c05-da51d0c9671a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef0e99c-b489-4ce5-b255-0d866f877af3', 'volume_name': 'volume-6ef0e99c-b489-4ce5-b255-0d866f877af3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1511a91c-687d-472a-a618-196611001cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1511a91c-687d-472a-a618-196611001cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37a2f52-481f-463b-8c4f-6e183e861b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:14 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume 6ef0e99c-b489-4ce5-b255-0d866f877af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef0e99c-b489-4ce5-b255-0d866f877af3', 'volume_size': 1} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:14 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ae9cbab-6549-4276-b687-3eeeeb333365" returned: 0 in 0.958s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-quobyte-6ae9cbab-6549-4276-b687-3eeeeb333365" released by "delete_volume" :: held 2.779s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Created reservations ['b10fa45d-8349-48d9-b077-2f19fe778f79', 'b153b15b-4fe3-4830-af36-0cd10ad6a4d0', '9d0637db-c8ed-4ad7-bf9a-2fb9c5a9c800', '2bf57d14-fe84-4107-aec3-41bf923b779c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Flow 'volume_create_manager' (a462a7f9-f09c-4ab7-859c-95d05763f6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd8b810-7dd5-46bd-a852-0e1f9ab2e080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:14 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256" returned: 0 in 1.228s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:14 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 is being set with open permissions: ugo+rw Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd8b810-7dd5-46bd-a852-0e1f9ab2e080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654302099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e93717-2251-4ec8-9534-a33e9f9c5cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35b2c83cf89425a996daad6c384e179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:14Z,use_quota=True,user_id='1c9bbfd9dee54edebe8fed51cf3fc835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc793ee-1ea2-40d2-82a2-2c1b3df397ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:14 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 Apr 29 09:09:14 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc793ee-1ea2-40d2-82a2-2c1b3df397ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1801e2-85a4-4f59-9bba-37240d3a803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1801e2-85a4-4f59-9bba-37240d3a803e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09e93717-2251-4ec8-9534-a33e9f9c5cdc', 'volume_name': 'volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84b26fa-f30d-4314-811c-7a08ddaf5fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84b26fa-f30d-4314-811c-7a08ddaf5fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b825a2e4-2880-46aa-9a17-9025bb3d024b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:14 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume 09e93717-2251-4ec8-9534-a33e9f9c5cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc', 'volume_size': 1} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:14 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:14 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:14 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "cinder-6640956b-fc93-498d-a5c4-5b39b12c9ebb-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-6640956b-fc93-498d-a5c4-5b39b12c9ebb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "cinder-quobyte-6640956b-fc93-498d-a5c4-5b39b12c9ebb" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-quobyte-6640956b-fc93-498d-a5c4-5b39b12c9ebb" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:15 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e7a644-93c1-4964-901f-9120aac126f2]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:15 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb Apr 29 09:09:15 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:15 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256" returned: 0 in 0.993s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:15 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.info Apr 29 09:09:15 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:15 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.983s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:15 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:15 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Deleted volume successfully. Apr 29 09:09:15 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-403d96f3-b30d-408c-bfbc-292b8452bf4c tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-6ae9cbab-6549-4276-b687-3eeeeb333365-delete_volume" released by "delete_volume" :: held 4.267s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:16 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb" returned: 0 in 0.900s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:16 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb Apr 29 09:09:16 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:16 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.info" returned: 0 in 0.815s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:16 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.info is being set with open permissions: ugo+rw Apr 29 09:09:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:16 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.info Apr 29 09:09:16 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:16 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6640956b-fc93-498d-a5c4-5b39b12c9ebb" returned: 0 in 0.786s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:16 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-quobyte-6640956b-fc93-498d-a5c4-5b39b12c9ebb" released by "delete_volume" :: held 1.755s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:16 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Created reservations ['bcd8d83f-3755-4dc4-be63-1f12b11bc9af', '30efa711-ea35-4759-8395-494b78be4e34', '034bd83a-7fe4-4f3f-91c0-b86ab4507c8a', '373e23f9-315f-4a7f-9b33-7c83a2dab17b'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:17 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:17 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:17 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.info" returned: 0 in 0.873s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.537s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.268s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1595642290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a854e9bd-aaf5-46ea-a411-b22604bcec2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35b2c83cf89425a996daad6c384e179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:12Z,use_quota=True,user_id='1c9bbfd9dee54edebe8fed51cf3fc835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Creating volume a854e9bd-aaf5-46ea-a411-b22604bcec2c {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:17 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "cinder-2a28aebc-992d-4858-a7e9-1d96fa8228c3-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:17 devstack sudo[93444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c 1073741824 Apr 29 09:09:17 devstack sudo[93444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-2a28aebc-992d-4858-a7e9-1d96fa8228c3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:17 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ef78aedb-6a85-497c-bdbe-924806773f16 tempest-VolumeDependencyTests-291119355 None] Create snapshot completed successfully Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "cinder-quobyte-2a28aebc-992d-4858-a7e9-1d96fa8228c3" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-quobyte-2a28aebc-992d-4858-a7e9-1d96fa8228c3" acquired by "delete_volume" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f92277c-484c-41fd-bc4c-6137fc05483b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:17 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.679s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:17 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Deleted volume successfully. Apr 29 09:09:17 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3 Apr 29 09:09:17 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-675ceaf1-d3e2-44f5-a39d-a9884bc4818a tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-6640956b-fc93-498d-a5c4-5b39b12c9ebb-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Flow 'volume_create_manager' (dabaf512-3d78-4ea9-9d4c-04edc70e624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:17 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c652ae64-d282-4a5b-b53a-81649979095e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c652ae64-d282-4a5b-b53a-81649979095e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1349552726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3fb154-71fe-45fe-91af-ba342d6c38a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea8ce8a4234759ae1d9a225bd85538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:18Z,use_quota=True,user_id='75c611710d06453399f9d59c18ad6ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bf0877-53dc-49a3-b522-b73fa8505f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bf0877-53dc-49a3-b522-b73fa8505f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584d5368-e1f8-413a-a596-6ab8998ea9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584d5368-e1f8-413a-a596-6ab8998ea9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3fb154-71fe-45fe-91af-ba342d6c38a6', 'volume_name': 'volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175c2638-1150-4e0c-be7d-341853abcab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175c2638-1150-4e0c-be7d-341853abcab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d0d09b-16ce-40fe-8e2b-c5a6348a3129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:18 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Volume ba3fb154-71fe-45fe-91af-ba342d6c38a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6', 'volume_size': 1} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:18 devstack sudo[93444]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c 1073741824" returned: 0 in 0.995s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:18 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c Apr 29 09:09:18 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:18 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3" returned: 0 in 0.864s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:18 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3 Apr 29 09:09:18 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Flow 'volume_create_manager' (bde5a226-43ef-4133-a4d1-7211700bb873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9527924-75a0-4e18-8fd2-6821da1f0063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9527924-75a0-4e18-8fd2-6821da1f0063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1652266157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12da8c1-c535-400e-ad86-b7bed916bd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5423d1a7de4782ae9db5ff70efc133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3a2487e8-f1bf-4f66-8d28-0db46e6ad256,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:19Z,use_quota=True,user_id='ea3a082d769b4cf2847bcb0ab38f955d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5aa21e4-0621-4e27-839c-e4b281a55bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5aa21e4-0621-4e27-839c-e4b281a55bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2189d92-57dd-480b-928f-fee4d274579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2189d92-57dd-480b-928f-fee4d274579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e12da8c1-c535-400e-ad86-b7bed916bd86', 'volume_name': 'volume-e12da8c1-c535-400e-ad86-b7bed916bd86', 'volume_size': 1, 'snapshot_id': '3a2487e8-f1bf-4f66-8d28-0db46e6ad256'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca25db0-d025-497f-a86a-9ecf7a6acf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca25db0-d025-497f-a86a-9ecf7a6acf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1d23d1-d059-4255-a9b6-69b3f3cf3d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:18 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Volume e12da8c1-c535-400e-ad86-b7bed916bd86: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e12da8c1-c535-400e-ad86-b7bed916bd86', 'volume_size': 1, 'snapshot_id': '3a2487e8-f1bf-4f66-8d28-0db46e6ad256'} Apr 29 09:09:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:19 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2a28aebc-992d-4858-a7e9-1d96fa8228c3" returned: 0 in 0.647s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-quobyte-2a28aebc-992d-4858-a7e9-1d96fa8228c3" released by "delete_volume" :: held 1.586s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:19 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c" returned: 0 in 0.745s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.334s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-944203804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765ad1ce-7dfc-4e4e-92db-93ffd2574c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35b2c83cf89425a996daad6c384e179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:13Z,use_quota=True,user_id='1c9bbfd9dee54edebe8fed51cf3fc835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Creating volume 765ad1ce-7dfc-4e4e-92db-93ffd2574c02 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:19 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:19 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02 1073741824 Apr 29 09:09:19 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2fdb3a-a80b-49af-8ba8-6d17c71919ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851f70ad-e8fd-4e17-992d-101283c9d4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Created reservations ['5f66eb03-0dd7-4947-bc0a-acdc51660269', 'c10c992d-7b56-473d-aa4f-83695e4f1baf', '967a6a93-18ec-4daf-b46d-3286490f5a82', '78e463a8-bb9c-4c83-8df4-a6c5766789a7'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:19 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c (a854e9bd-aaf5-46ea-a411-b22604bcec2c): created successfully Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851f70ad-e8fd-4e17-992d-101283c9d4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Flow 'volume_create_manager' (5c8891f1-e988-4d9c-a363-cf5f0ca48f17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:19 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-56425465-7941-4516-8a1a-74b17d99a4de tempest-CreateVolumesFromSnapshotTest-40906556 None] Created volume successfully. Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:19 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:19 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:19 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.666s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:19 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:19 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Deleted volume successfully. Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-95f1d189-8153-4297-8511-1ba947043dfe tempest-CreateVolumesFromImageTest-1467833295 None] Lock "cinder-2a28aebc-992d-4858-a7e9-1d96fa8228c3-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:20 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02 1073741824" returned: 0 in 1.008s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:20 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02 Apr 29 09:09:20 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:20 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02" returned: 0 in 0.651s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.612s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1820696345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6fe6fc-0e53-4259-b41d-ecfb333ca253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35b2c83cf89425a996daad6c384e179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:13Z,use_quota=True,user_id='1c9bbfd9dee54edebe8fed51cf3fc835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Creating volume 2b6fe6fc-0e53-4259-b41d-ecfb333ca253 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:20 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:20 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253 1073741824 Apr 29 09:09:20 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911e959f-adb7-401f-b1b3-ba357fa21cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0db755e-71b0-4f87-a228-ff318e1a17ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:20 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02 (765ad1ce-7dfc-4e4e-92db-93ffd2574c02): created successfully Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0db755e-71b0-4f87-a228-ff318e1a17ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Flow 'volume_create_manager' (d91a5631-4b90-4a5f-aeea-2ff7e8f107f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:20 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-29b63f77-97d9-4b0f-82ae-213c9a1955d0 tempest-CreateVolumesFromSnapshotTest-40906556 None] Created volume successfully. Apr 29 09:09:21 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253 1073741824" returned: 0 in 0.886s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:21 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253 Apr 29 09:09:21 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:22 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253" returned: 0 in 0.704s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.273s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-367443504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef0e99c-b489-4ce5-b255-0d866f877af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35b2c83cf89425a996daad6c384e179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:14Z,use_quota=True,user_id='1c9bbfd9dee54edebe8fed51cf3fc835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Creating volume 6ef0e99c-b489-4ce5-b255-0d866f877af3 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:22 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ef0e99c-b489-4ce5-b255-0d866f877af3 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5df8acd-e48a-4d6a-a708-4dc09104c40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c543d961-b2a6-4e87-ba5a-3ba85c11ae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:22 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ef0e99c-b489-4ce5-b255-0d866f877af3 1073741824 Apr 29 09:09:22 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:22 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253 (2b6fe6fc-0e53-4259-b41d-ecfb333ca253): created successfully Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c543d961-b2a6-4e87-ba5a-3ba85c11ae21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Flow 'volume_create_manager' (93304733-0e83-460b-aad5-70265804770c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:22 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ee8af9ee-ff3f-4922-a8f3-62edb3334cf7 tempest-CreateVolumesFromSnapshotTest-40906556 None] Created volume successfully. Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Flow 'volume_create_manager' (b1f9ce06-f09f-4d0b-9269-c94a21e20bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cead7bf-4eab-4778-ac90-1f87d53b012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cead7bf-4eab-4778-ac90-1f87d53b012c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3cf4b6-2b19-44e7-9074-3842a81fbe7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335e4f29fa574db9b2a37167b672f536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:23Z,use_quota=True,user_id='16e6765ae01b405482d5a3bcf476ec6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1ef698-32a8-45ea-9140-6efc11bbf8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1ef698-32a8-45ea-9140-6efc11bbf8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509429f1-c19a-42a7-9193-bc8fd6c8939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509429f1-c19a-42a7-9193-bc8fd6c8939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3cf4b6-2b19-44e7-9074-3842a81fbe7c', 'volume_name': 'volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd95d74-7f6a-4b92-84fa-b2fa8fdabb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd95d74-7f6a-4b92-84fa-b2fa8fdabb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2516d00f-0c7c-4d95-8981-dd753776022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:22 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Volume 1b3cf4b6-2b19-44e7-9074-3842a81fbe7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c', 'volume_size': 1} Apr 29 09:09:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:23 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ef0e99c-b489-4ce5-b255-0d866f877af3 1073741824" returned: 0 in 0.895s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ef0e99c-b489-4ce5-b255-0d866f877af3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:23 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ef0e99c-b489-4ce5-b255-0d866f877af3 Apr 29 09:09:23 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:24 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ef0e99c-b489-4ce5-b255-0d866f877af3" returned: 0 in 0.584s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.381s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654302099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e93717-2251-4ec8-9534-a33e9f9c5cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35b2c83cf89425a996daad6c384e179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:14Z,use_quota=True,user_id='1c9bbfd9dee54edebe8fed51cf3fc835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Creating volume 09e93717-2251-4ec8-9534-a33e9f9c5cdc {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:24 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:24 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc 1073741824 Apr 29 09:09:24 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37a2f52-481f-463b-8c4f-6e183e861b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef0e99c-b489-4ce5-b255-0d866f877af3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8f493c-bf78-4191-8d70-53e159fad590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:24 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume volume-6ef0e99c-b489-4ce5-b255-0d866f877af3 (6ef0e99c-b489-4ce5-b255-0d866f877af3): created successfully Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8f493c-bf78-4191-8d70-53e159fad590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Flow 'volume_create_manager' (b092c671-5978-415c-ab6b-6271b34b441b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:24 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a019cd01-c2ab-4c4c-b550-91ef4dc97882 tempest-CreateVolumesFromSnapshotTest-40906556 None] Created volume successfully. Apr 29 09:09:24 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc 1073741824" returned: 0 in 0.808s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:24 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc Apr 29 09:09:24 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:25 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc" returned: 0 in 0.668s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.521s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1349552726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3fb154-71fe-45fe-91af-ba342d6c38a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea8ce8a4234759ae1d9a225bd85538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:18Z,use_quota=True,user_id='75c611710d06453399f9d59c18ad6ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Creating volume ba3fb154-71fe-45fe-91af-ba342d6c38a6 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:25 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b825a2e4-2880-46aa-9a17-9025bb3d024b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:25 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 1073741824 Apr 29 09:09:25 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308e6f01-7ee0-4a51-9228-93d2e30fa12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:25 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Volume volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc (09e93717-2251-4ec8-9534-a33e9f9c5cdc): created successfully Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308e6f01-7ee0-4a51-9228-93d2e30fa12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:25 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Flow 'volume_create_manager' (a462a7f9-f09c-4ab7-859c-95d05763f6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:25 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-fdd25352-563f-4881-8740-9a834c3f4423 tempest-CreateVolumesFromSnapshotTest-40906556 None] Created volume successfully. Apr 29 09:09:26 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 1073741824" returned: 0 in 0.843s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:26 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 Apr 29 09:09:26 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:26 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-09e93717-2251-4ec8-9534-a33e9f9c5cdc-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:26 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-09e93717-2251-4ec8-9534-a33e9f9c5cdc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:26 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-quobyte-09e93717-2251-4ec8-9534-a33e9f9c5cdc" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:26 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-09e93717-2251-4ec8-9534-a33e9f9c5cdc" acquired by "delete_volume" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:26 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ac2c8e-b31e-4141-a82a-b0ee3d302d22]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:26 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc Apr 29 09:09:26 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:27 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6" returned: 0 in 0.599s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.293s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-quobyte-3a2487e8-f1bf-4f66-8d28-0db46e6ad256-e12da8c1-c535-400e-ad86-b7bed916bd86" by "_create_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d0d09b-16ce-40fe-8e2b-c5a6348a3129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833d2d90-d06c-4474-be6c-96a16fe1c4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-3a2487e8-f1bf-4f66-8d28-0db46e6ad256-e12da8c1-c535-400e-ad86-b7bed916bd86" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Creating volume e12da8c1-c535-400e-ad86-b7bed916bd86 from snapshot 3a2487e8-f1bf-4f66-8d28-0db46e6ad256 {{(pid=83712) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-quobyte-e12da8c1-c535-400e-ad86-b7bed916bd86" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:27 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Volume volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 (ba3fb154-71fe-45fe-91af-ba342d6c38a6): created successfully Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833d2d90-d06c-4474-be6c-96a16fe1c4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Flow 'volume_create_manager' (dabaf512-3d78-4ea9-9d4c-04edc70e624f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-e12da8c1-c535-400e-ad86-b7bed916bd86" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] snapshot: 3a2487e8-f1bf-4f66-8d28-0db46e6ad256, volume: e12da8c1-c535-400e-ad86-b7bed916bd86, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:09:27 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-018572dd-fc53-4f96-ab52-a082f5a8627f tempest-SnapshotDependencyTests-975185021 None] Created volume successfully. Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8135b5-2348-4f3d-b27d-3df903671879]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:27 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 Apr 29 09:09:27 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:27 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc" returned: 0 in 0.764s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:27 devstack sudo[93517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc Apr 29 09:09:27 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:28 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256" returned: 0 in 0.831s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[83167dd7-20f7-4e95-9223-a6ed007a2a34]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:28 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb Apr 29 09:09:28 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:28 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-09e93717-2251-4ec8-9534-a33e9f9c5cdc" returned: 0 in 0.672s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-09e93717-2251-4ec8-9534-a33e9f9c5cdc" released by "delete_volume" :: held 1.492s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Created reservations ['df8bf903-ec6a-43b1-b7b3-514c90a07fe7', '8cc8b016-f211-4af8-88e4-ccb4c2f2d58f', 'cf396656-ef5f-486f-ad94-a3c75e753f46', '99028df6-43a4-44b8-aad3-207cc302c169'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:28 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:28 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:28 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb" returned: 0 in 0.821s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86 not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:09:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:28 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86 Apr 29 09:09:28 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-6ef0e99c-b489-4ce5-b255-0d866f877af3-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-6ef0e99c-b489-4ce5-b255-0d866f877af3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:29 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-quobyte-6ef0e99c-b489-4ce5-b255-0d866f877af3" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.671s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:29 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:29 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Deleted volume successfully. Apr 29 09:09:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-6ef0e99c-b489-4ce5-b255-0d866f877af3" acquired by "delete_volume" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:29 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e8c38b43-08d8-4345-b845-2d0672156fcf tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-09e93717-2251-4ec8-9534-a33e9f9c5cdc-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:29 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbaa0dc-351a-468a-b339-85be4eee69be]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ef0e99c-b489-4ce5-b255-0d866f877af3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:29 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ef0e99c-b489-4ce5-b255-0d866f877af3 Apr 29 09:09:29 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:30 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ef0e99c-b489-4ce5-b255-0d866f877af3" returned: 0 in 1.211s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ef0e99c-b489-4ce5-b255-0d866f877af3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:30 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ef0e99c-b489-4ce5-b255-0d866f877af3 Apr 29 09:09:30 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:31 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-6ef0e99c-b489-4ce5-b255-0d866f877af3" returned: 0 in 1.404s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-6ef0e99c-b489-4ce5-b255-0d866f877af3" released by "delete_volume" :: held 2.693s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:31 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Created reservations ['5d781833-0877-4038-8821-0ccba9a84735', '603d57a1-6a57-45f5-b129-ae2bfc8a05e9', '75a69db2-ea4d-4c97-ae9c-d704af7ae148', '7a8ef039-d9e9-4933-bf20-1997e2c2d0d8'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:32 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:32 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:32 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:32 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-2b6fe6fc-0e53-4259-b41d-ecfb333ca253-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-2b6fe6fc-0e53-4259-b41d-ecfb333ca253-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-quobyte-2b6fe6fc-0e53-4259-b41d-ecfb333ca253" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-2b6fe6fc-0e53-4259-b41d-ecfb333ca253" acquired by "delete_volume" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:32 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e04259-c3d1-4ede-8fcf-ca0ac97e2df1]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:33 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253 Apr 29 09:09:33 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:34 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 2.171s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:34 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:34 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Deleted volume successfully. Apr 29 09:09:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-9a5378a8-32c9-4f3f-872d-eb084c48fb87 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-6ef0e99c-b489-4ce5-b255-0d866f877af3-delete_volume" released by "delete_volume" :: held 5.353s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:34 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253" returned: 0 in 1.612s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:34 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253 Apr 29 09:09:34 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:34 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86" returned: 0 in 5.906s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:34 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f21dc3e-ebc9-402f-8064-464ac7538bed]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:34 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb Apr 29 09:09:34 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:35 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-2b6fe6fc-0e53-4259-b41d-ecfb333ca253" returned: 0 in 0.726s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-2b6fe6fc-0e53-4259-b41d-ecfb333ca253" released by "delete_volume" :: held 2.442s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:35 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Created reservations ['da5f0a67-11f4-48c7-9484-8a8680a0256d', 'cb17234b-ec29-4ec9-9992-88d07ff0d66b', 'b580d49c-d5e5-42a6-af56-f853397687fa', '6aa21579-7299-466c-83b0-3e6807a1131c'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:35 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:35 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:35 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:35 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb" returned: 0 in 0.917s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:35 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86 {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:09:35 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Converted 1024.00 MB image at 173.32 MB/s Apr 29 09:09:35 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86 is being set with open permissions: ugo+rw Apr 29 09:09:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:35 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86 Apr 29 09:09:35 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:36 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.639s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:36 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Deleted volume successfully. Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-58655953-4b8f-4d7c-b444-00b2fdc98eaf tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-2b6fe6fc-0e53-4259-b41d-ecfb333ca253-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-765ad1ce-7dfc-4e4e-92db-93ffd2574c02-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-765ad1ce-7dfc-4e4e-92db-93ffd2574c02-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-quobyte-765ad1ce-7dfc-4e4e-92db-93ffd2574c02" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-765ad1ce-7dfc-4e4e-92db-93ffd2574c02" acquired by "delete_volume" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7a977c-ab35-4c6c-bb7b-5d9a488fd740]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:36 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86" returned: 0 in 0.593s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-e12da8c1-c535-400e-ad86-b7bed916bd86" released by "_copy_volume_from_snapshot" :: held 9.184s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-3a2487e8-f1bf-4f66-8d28-0db46e6ad256-e12da8c1-c535-400e-ad86-b7bed916bd86" released by "_create_volume_from_snapshot" :: held 9.242s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.281s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.568s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3cf4b6-2b19-44e7-9074-3842a81fbe7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335e4f29fa574db9b2a37167b672f536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:23Z,use_quota=True,user_id='16e6765ae01b405482d5a3bcf476ec6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Creating volume 1b3cf4b6-2b19-44e7-9074-3842a81fbe7c {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:36 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:36 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c 1073741824 Apr 29 09:09:36 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1d23d1-d059-4255-a9b6-69b3f3cf3d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e12da8c1-c535-400e-ad86-b7bed916bd86', 'volume_size': 1, 'snapshot_id': '3a2487e8-f1bf-4f66-8d28-0db46e6ad256'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503e9f5e-2a6a-46b3-9f3f-311e282ed7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:36 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02 Apr 29 09:09:36 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:36 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Volume volume-e12da8c1-c535-400e-ad86-b7bed916bd86 (e12da8c1-c535-400e-ad86-b7bed916bd86): created successfully Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503e9f5e-2a6a-46b3-9f3f-311e282ed7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:36 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Flow 'volume_create_manager' (bde5a226-43ef-4133-a4d1-7211700bb873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:36 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-aa2f65e2-1735-48ea-b3fc-d8227b222263 tempest-VolumeDependencyTests-291119355 None] Created volume successfully. Apr 29 09:09:37 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02" returned: 0 in 0.719s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:37 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02 Apr 29 09:09:37 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-3a2487e8-f1bf-4f66-8d28-0db46e6ad256-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-3a2487e8-f1bf-4f66-8d28-0db46e6ad256-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-quobyte-ea7a1c9e-e1f9-484b-8156-9b817159faeb" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-ea7a1c9e-e1f9-484b-8156-9b817159faeb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-quobyte-3a2487e8-f1bf-4f66-8d28-0db46e6ad256" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:37 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c 1073741824" returned: 0 in 0.833s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-3a2487e8-f1bf-4f66-8d28-0db46e6ad256" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Deleting offline snapshot 3a2487e8-f1bf-4f66-8d28-0db46e6ad256 of volume ea7a1c9e-e1f9-484b-8156-9b817159faeb {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] snapshot_file for this snap is: volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed476f5-2435-4b58-898d-5b624b57d6f3]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:37 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c Apr 29 09:09:37 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:37 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 Apr 29 09:09:37 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:37 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-765ad1ce-7dfc-4e4e-92db-93ffd2574c02" returned: 0 in 0.643s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-765ad1ce-7dfc-4e4e-92db-93ffd2574c02" released by "delete_volume" :: held 1.409s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Created reservations ['becd2b74-fcb6-43e7-b222-7e9bd58da70c', '2140a61f-3c5e-4c1d-b231-c8fa759deacb', '7529d6ed-6f63-4473-8f67-2b71e4884a62', '3620fa63-dcfa-44c2-8e06-88c0267a7eb1'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:37 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:37 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:37 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c" returned: 0 in 0.613s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.033s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2516d00f-0c7c-4d95-8981-dd753776022e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419ce50f-4cda-40b5-a4ce-77ee80e1da3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] Creating offline snapshot 33b177b7-ce26-414a-a915-28bf0f356a16 of volume ba3fb154-71fe-45fe-91af-ba342d6c38a6 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:09:37 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Volume volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c (1b3cf4b6-2b19-44e7-9074-3842a81fbe7c): created successfully Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419ce50f-4cda-40b5-a4ce-77ee80e1da3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Flow 'volume_create_manager' (b1f9ce06-f09f-4d0b-9269-c94a21e20bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7d98a2-88e5-424a-8424-50065af6051b]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:37 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d33b86c3-9734-4d7e-987d-c8a57482566b tempest-CinderUnicodeTest-1442031092 None] Created volume successfully. Apr 29 09:09:37 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256" returned: 0 in 0.755s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6de4a6-66a0-4279-9fd2-4ad903561109]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:38 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 Apr 29 09:09:38 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:38 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb Apr 29 09:09:38 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:38 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-a854e9bd-aaf5-46ea-a411-b22604bcec2c-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.683s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:38 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Deleted volume successfully. Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-a854e9bd-aaf5-46ea-a411-b22604bcec2c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7dce11aa-f409-4149-830b-89ccdd223fc4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-765ad1ce-7dfc-4e4e-92db-93ffd2574c02-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-quobyte-a854e9bd-aaf5-46ea-a411-b22604bcec2c" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-a854e9bd-aaf5-46ea-a411-b22604bcec2c" acquired by "delete_volume" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[77937962-da45-412f-90f9-c69641eaaac6]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Flow 'volume_create_manager' (9c2e8035-b3fb-497c-abda-60fdd7404477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb331c0-38fb-45d5-b506-c7514a644cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb331c0-38fb-45d5-b506-c7514a644cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1466326411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f82f46-79a4-43bb-8dfc-be8b21165952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335e4f29fa574db9b2a37167b672f536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:39Z,use_quota=True,user_id='16e6765ae01b405482d5a3bcf476ec6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:38 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c Apr 29 09:09:38 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f61be8f-3f8f-4a7d-814a-cdf5ccca3b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f61be8f-3f8f-4a7d-814a-cdf5ccca3b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fad3a7-5e0e-4409-85a6-bdca8367a143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fad3a7-5e0e-4409-85a6-bdca8367a143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f82f46-79a4-43bb-8dfc-be8b21165952', 'volume_name': 'volume-39f82f46-79a4-43bb-8dfc-be8b21165952', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5670ed-e1b7-4841-938b-84b569ce3e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5670ed-e1b7-4841-938b-84b569ce3e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c8084e-a089-4952-b4d8-85e6285df38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:38 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Volume 39f82f46-79a4-43bb-8dfc-be8b21165952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f82f46-79a4-43bb-8dfc-be8b21165952', 'volume_size': 1} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:38 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb" returned: 0 in 0.937s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:38 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6" returned: 0 in 1.038s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:39 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 Apr 29 09:09:39 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:39 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 1G Apr 29 09:09:39 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:39 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c" returned: 0 in 0.846s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:39 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c Apr 29 09:09:39 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:39 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256" returned: 0 in 0.763s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:39 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256 Apr 29 09:09:39 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:39 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 1G" returned: 0 in 0.810s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:39 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 Apr 29 09:09:39 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:40 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-a854e9bd-aaf5-46ea-a411-b22604bcec2c" returned: 0 in 0.656s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-a854e9bd-aaf5-46ea-a411-b22604bcec2c" released by "delete_volume" :: held 1.573s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Created reservations ['dd0a730d-05a4-4805-a4ab-aa01651a0021', 'ee9edc75-9dfe-4d37-b463-dbe12c128243', '4c6c59ce-df23-4bfd-b8d9-e839fb6bb060', '06996f12-6b0b-4abd-86de-f1ac5d1b7241'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:40 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:40 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:40 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb.3a2487e8-f1bf-4f66-8d28-0db46e6ad256" returned: 0 in 0.656s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-3a2487e8-f1bf-4f66-8d28-0db46e6ad256" released by "_delete_snapshot" :: held 3.219s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-ea7a1c9e-e1f9-484b-8156-9b817159faeb" released by "delete_snapshot" :: held 3.247s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Created reservations ['226b1b5e-c4ac-4799-bf2c-98b44967852e', '30b224e2-c5f3-49cd-b791-3f6c760d3919', 'a7bada8d-2496-491d-98e6-6818ec6bc6b8', '424a16be-1499-476a-9b0d-48a55cf96268'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:40 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16" returned: 0 in 0.698s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:40 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 is being set with open permissions: ugo+rw Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:40 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 Apr 29 09:09:40 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:40 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Delete snapshot completed successfully. Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-eabcface-3605-46c4-9ab7-71a2b2bac8e5 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-3a2487e8-f1bf-4f66-8d28-0db46e6ad256-delete_snapshot" released by "delete_snapshot" :: held 3.434s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-c9448bcf-aec2-4458-8cad-3067b5256114-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-c9448bcf-aec2-4458-8cad-3067b5256114-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-quobyte-9685af0c-729e-4360-b411-d228b6054dca" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-9685af0c-729e-4360-b411-d228b6054dca" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-quobyte-c9448bcf-aec2-4458-8cad-3067b5256114" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-c9448bcf-aec2-4458-8cad-3067b5256114" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Deleting offline snapshot c9448bcf-aec2-4458-8cad-3067b5256114 of volume 9685af0c-729e-4360-b411-d228b6054dca {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] snapshot_file for this snap is: volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[090a9b1a-8235-44ab-bfe4-1728cf7bc2e5]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:41 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.661s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:41 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Deleted volume successfully. Apr 29 09:09:41 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-0b1c98ec-2f52-4fae-8e71-668d7386198a tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-a854e9bd-aaf5-46ea-a411-b22604bcec2c-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:41 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:41 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16" returned: 0 in 0.679s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:41 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.info Apr 29 09:09:41 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-ea7a1c9e-e1f9-484b-8156-9b817159faeb-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-ea7a1c9e-e1f9-484b-8156-9b817159faeb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-quobyte-ea7a1c9e-e1f9-484b-8156-9b817159faeb" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-ea7a1c9e-e1f9-484b-8156-9b817159faeb" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db042ae-0f64-42f9-a2a0-5b3ab37e00a0]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:41 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb Apr 29 09:09:41 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:41 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114" returned: 0 in 0.857s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9685af0c-729e-4360-b411-d228b6054dca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[6021a0fe-3852-4f15-8479-de17fbcd7730]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:41 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.info" returned: 0 in 0.695s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:41 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.info is being set with open permissions: ugo+rw Apr 29 09:09:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:41 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca Apr 29 09:09:41 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:41 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.info Apr 29 09:09:41 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:42 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb" returned: 0 in 0.743s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:42 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb Apr 29 09:09:42 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:42 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.info" returned: 0 in 0.664s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.715s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.722s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1466326411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f82f46-79a4-43bb-8dfc-be8b21165952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335e4f29fa574db9b2a37167b672f536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:39Z,use_quota=True,user_id='16e6765ae01b405482d5a3bcf476ec6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Creating volume 39f82f46-79a4-43bb-8dfc-be8b21165952 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:42 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:42 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 1073741824 Apr 29 09:09:42 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:42 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca" returned: 0 in 0.844s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:42 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-2570dd45-d5cb-4541-98f8-2406ba3dfb55 tempest-SnapshotDependencyTests-975185021 None] Create snapshot completed successfully Apr 29 09:09:42 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 Apr 29 09:09:42 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:43 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ea7a1c9e-e1f9-484b-8156-9b817159faeb" returned: 0 in 0.745s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-ea7a1c9e-e1f9-484b-8156-9b817159faeb" released by "delete_volume" :: held 1.573s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Created reservations ['f69d4944-5eba-4921-9fd6-6e48a7415b13', '7e1ee56f-a8c0-4d12-874e-4c13f217d05d', '1bf618a1-eeb2-41ef-849a-ca82a8bd4d6d', '2d81aaa1-150c-4ea2-b8f8-1db3e0db9113'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:43 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:43 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Flow 'volume_create_manager' (5db45cd6-d160-4088-aec1-8a69a98412a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7690f91c-094c-45a9-b2ee-e3b1691e8fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:43 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 1073741824" returned: 0 in 0.941s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7690f91c-094c-45a9-b2ee-e3b1691e8fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e36e2d-2e51-478e-8e44-90ed20a820ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea8ce8a4234759ae1d9a225bd85538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=33b177b7-ce26-414a-a915-28bf0f356a16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:43Z,use_quota=True,user_id='75c611710d06453399f9d59c18ad6ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d968666c-bf18-4bbc-84c2-8a3ea24cd312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d968666c-bf18-4bbc-84c2-8a3ea24cd312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658d752a-85d3-40ba-9222-fcfe49359480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658d752a-85d3-40ba-9222-fcfe49359480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2e36e2d-2e51-478e-8e44-90ed20a820ed', 'volume_name': 'volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed', 'volume_size': 1, 'snapshot_id': '33b177b7-ce26-414a-a915-28bf0f356a16'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925ea06f-c1f4-4ebb-adc6-80e94dc1ed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925ea06f-c1f4-4ebb-adc6-80e94dc1ed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:43 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a665df57-3cc8-42d4-b0f6-4ce97464f73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:43 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Volume b2e36e2d-2e51-478e-8e44-90ed20a820ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed', 'volume_size': 1, 'snapshot_id': '33b177b7-ce26-414a-a915-28bf0f356a16'} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114" returned: 0 in 0.971s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:43 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114 Apr 29 09:09:43 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:43 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 Apr 29 09:09:43 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:43 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.808s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:43 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:44 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Deleted volume successfully. Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-4084ac56-b437-43d6-b368-5c1c3fa94cd4 tempest-VolumeDependencyTests-291119355 None] Lock "cinder-ea7a1c9e-e1f9-484b-8156-9b817159faeb-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Flow 'volume_create_manager' (fede8256-bf61-4ccb-a0ee-4d38f9779c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38372912-268b-4650-b69d-8ff9d4dbfe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38372912-268b-4650-b69d-8ff9d4dbfe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-878336942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b47ae6c-112f-4103-9bf6-477bdac09037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5423d1a7de4782ae9db5ff70efc133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:44Z,use_quota=True,user_id='ea3a082d769b4cf2847bcb0ab38f955d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6028dd-77f9-4673-8430-f417c9a42c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6028dd-77f9-4673-8430-f417c9a42c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cd8a18-238d-41f7-a6c1-b9195adb986e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cd8a18-238d-41f7-a6c1-b9195adb986e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b47ae6c-112f-4103-9bf6-477bdac09037', 'volume_name': 'volume-8b47ae6c-112f-4103-9bf6-477bdac09037', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513d2207-f1d6-49a3-93b1-e9bff9922aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513d2207-f1d6-49a3-93b1-e9bff9922aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b165f6f-85b2-4f5e-97a8-3fe51630df9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:44 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Volume 8b47ae6c-112f-4103-9bf6-477bdac09037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b47ae6c-112f-4103-9bf6-477bdac09037', 'volume_size': 1} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:44 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca.c9448bcf-aec2-4458-8cad-3067b5256114" returned: 0 in 0.739s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-c9448bcf-aec2-4458-8cad-3067b5256114" released by "_delete_snapshot" :: held 3.582s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-9685af0c-729e-4360-b411-d228b6054dca" released by "delete_snapshot" :: held 3.611s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:44 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952" returned: 0 in 0.797s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.828s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "cinder-quobyte-33b177b7-ce26-414a-a915-28bf0f356a16-b2e36e2d-2e51-478e-8e44-90ed20a820ed" by "_create_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c8084e-a089-4952-b4d8-85e6285df38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f82f46-79a4-43bb-8dfc-be8b21165952', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab99f778-c108-4877-89fb-68cc3fabc327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-quobyte-33b177b7-ce26-414a-a915-28bf0f356a16-b2e36e2d-2e51-478e-8e44-90ed20a820ed" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Creating volume b2e36e2d-2e51-478e-8e44-90ed20a820ed from snapshot 33b177b7-ce26-414a-a915-28bf0f356a16 {{(pid=83712) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "cinder-quobyte-b2e36e2d-2e51-478e-8e44-90ed20a820ed" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Created reservations ['515ab2b1-6b9b-4509-acaf-b554ba1f5da4', '43dbbedf-6ee6-4143-96cf-7a3a51870ee1', '5cf0f584-1737-4b06-8592-665ecd844211', 'dc2f7bda-d591-4b8d-8fb4-fa186b786e5b'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:44 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Volume volume-39f82f46-79a4-43bb-8dfc-be8b21165952 (39f82f46-79a4-43bb-8dfc-be8b21165952): created successfully Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab99f778-c108-4877-89fb-68cc3fabc327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Flow 'volume_create_manager' (9c2e8035-b3fb-497c-abda-60fdd7404477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-quobyte-b2e36e2d-2e51-478e-8e44-90ed20a820ed" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] snapshot: 33b177b7-ce26-414a-a915-28bf0f356a16, volume: b2e36e2d-2e51-478e-8e44-90ed20a820ed, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:44 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-afc0cdc1-9215-497f-a903-b8556b9fec84 tempest-CinderUnicodeTest-1442031092 None] Created volume successfully. Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3a7712-7e82-43db-90f7-0e6087e9f852]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:44 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Delete snapshot completed successfully. Apr 29 09:09:44 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c1d2cd1e-f1a6-41dc-a3fb-0b3bbecd8fd4 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-c9448bcf-aec2-4458-8cad-3067b5256114-delete_snapshot" released by "delete_snapshot" :: held 3.934s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:44 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 Apr 29 09:09:44 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-9685af0c-729e-4360-b411-d228b6054dca-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-9685af0c-729e-4360-b411-d228b6054dca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "cinder-quobyte-9685af0c-729e-4360-b411-d228b6054dca" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-9685af0c-729e-4360-b411-d228b6054dca" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[60246f7c-2915-4c2a-b2ea-fdf9616d72d4]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:45 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca Apr 29 09:09:45 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:45 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16" returned: 0 in 0.826s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c89a24f-7f8c-4f44-b7e2-4f99fd3254d9]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:45 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 Apr 29 09:09:45 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:45 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:46 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca" returned: 0 in 0.821s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:46 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca Apr 29 09:09:46 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:46 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6" returned: 0 in 0.898s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:46 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed Apr 29 09:09:46 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:46 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9685af0c-729e-4360-b411-d228b6054dca" returned: 0 in 0.701s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-quobyte-9685af0c-729e-4360-b411-d228b6054dca" released by "delete_volume" :: held 1.608s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Created reservations ['4d76d379-eb16-43f1-8159-a2477d21c82d', '73568b98-b9bf-464f-bdcf-990ea468c28e', 'd991215b-5427-4d9a-959b-94fc1785e024', '24b20411-1875-4872-9d8b-4ebd137d04a6'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:46 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:46 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:46 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:48 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:48 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.602s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:48 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:48 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Deleted volume successfully. Apr 29 09:09:48 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-c9f497d3-4d82-42b2-aa60-4115c180c773 tempest-CreateVolumesFromSnapshotTest-40906556 None] Lock "cinder-9685af0c-729e-4360-b411-d228b6054dca-delete_volume" released by "delete_volume" :: held 3.547s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:52 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed" returned: 0 in 6.056s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:52 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a721f06-5f7c-4153-8fc9-e5858369b075]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:52 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:52 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 Apr 29 09:09:52 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:53 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6" returned: 0 in 0.911s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:09:53 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Converted 1024.00 MB image at 169.05 MB/s Apr 29 09:09:53 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed is being set with open permissions: ugo+rw Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:53 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed Apr 29 09:09:53 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=123,cinder:UPDATE=168,cinder:INSERT=29,cinder:DELETE=16 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=113,cinder:UPDATE=153,cinder:DELETE=15,cinder:INSERT=45 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Flow 'volume_create_manager' (7087772e-e3b8-44cb-af73-417463690818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a7bccf-43ed-4444-8809-129b228f1aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a7bccf-43ed-4444-8809-129b228f1aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-625185209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882d15e3-dfd8-45b9-8fad-db984a230981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbb17a13e4242428958e39cf00b77d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:54Z,use_quota=True,user_id='1955c257b59b4c83801e3b4f2255a1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8af40f1-c08b-4ba2-b242-b6e74cf07201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8af40f1-c08b-4ba2-b242-b6e74cf07201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fb23a9-adca-4b05-8d83-d9e6e088df05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fb23a9-adca-4b05-8d83-d9e6e088df05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882d15e3-dfd8-45b9-8fad-db984a230981', 'volume_name': 'volume-882d15e3-dfd8-45b9-8fad-db984a230981', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7f2166-4b23-424a-b4ad-d9b3e31d7aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7f2166-4b23-424a-b4ad-d9b3e31d7aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f00a9e-9449-474a-bd18-7b404310d55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:53 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume 882d15e3-dfd8-45b9-8fad-db984a230981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882d15e3-dfd8-45b9-8fad-db984a230981', 'volume_size': 1} Apr 29 09:09:53 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:54 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed" returned: 0 in 0.680s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-quobyte-b2e36e2d-2e51-478e-8e44-90ed20a820ed" released by "_copy_volume_from_snapshot" :: held 9.503s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-quobyte-33b177b7-ce26-414a-a915-28bf0f356a16-b2e36e2d-2e51-478e-8e44-90ed20a820ed" released by "_create_volume_from_snapshot" :: held 9.566s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.603s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.776s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-878336942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b47ae6c-112f-4103-9bf6-477bdac09037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5423d1a7de4782ae9db5ff70efc133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:44Z,use_quota=True,user_id='ea3a082d769b4cf2847bcb0ab38f955d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Creating volume 8b47ae6c-112f-4103-9bf6-477bdac09037 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:54 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:54 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 1073741824 Apr 29 09:09:54 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a665df57-3cc8-42d4-b0f6-4ce97464f73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed', 'volume_size': 1, 'snapshot_id': '33b177b7-ce26-414a-a915-28bf0f356a16'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d7eafa-8778-418a-9aee-35eb261b7d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:54 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Volume volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed (b2e36e2d-2e51-478e-8e44-90ed20a820ed): created successfully Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d7eafa-8778-418a-9aee-35eb261b7d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Flow 'volume_create_manager' (5db45cd6-d160-4088-aec1-8a69a98412a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:54 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-45db3572-cfca-4563-b02c-ad1a03809e19 tempest-SnapshotDependencyTests-975185021 None] Created volume successfully. Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "cinder-33b177b7-ce26-414a-a915-28bf0f356a16-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-33b177b7-ce26-414a-a915-28bf0f356a16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "cinder-quobyte-ba3fb154-71fe-45fe-91af-ba342d6c38a6" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-quobyte-ba3fb154-71fe-45fe-91af-ba342d6c38a6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "cinder-quobyte-33b177b7-ce26-414a-a915-28bf0f356a16" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-quobyte-33b177b7-ce26-414a-a915-28bf0f356a16" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Deleting offline snapshot 33b177b7-ce26-414a-a915-28bf0f356a16 of volume ba3fb154-71fe-45fe-91af-ba342d6c38a6 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] snapshot_file for this snap is: volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[22998d74-7388-47db-9a41-3a29c133d21d]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:54 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:54 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 Apr 29 09:09:54 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:55 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 1073741824" returned: 0 in 0.905s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:55 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 Apr 29 09:09:55 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:55 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16" returned: 0 in 0.777s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[7141b531-7be8-4631-9a5c-4756eb81bc00]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:55 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037" returned: 0 in 0.635s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.989s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] Creating offline snapshot fa80db73-c608-47fb-9438-0b7c9c819317 of volume 39f82f46-79a4-43bb-8dfc-be8b21165952 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b165f6f-85b2-4f5e-97a8-3fe51630df9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b47ae6c-112f-4103-9bf6-477bdac09037', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28af034-b933-40db-b2a0-04466c4ad5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db2d787-0a21-4d0f-bade-6db57ff1ece6]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:55 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 Apr 29 09:09:55 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:55 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Volume volume-8b47ae6c-112f-4103-9bf6-477bdac09037 (8b47ae6c-112f-4103-9bf6-477bdac09037): created successfully Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28af034-b933-40db-b2a0-04466c4ad5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:55 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Flow 'volume_create_manager' (fede8256-bf61-4ccb-a0ee-4d38f9779c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:55 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-eea510b3-fa5a-4e73-a661-3ea167ff4055 tempest-VolumeDependencyTests-291119355 None] Created volume successfully. Apr 29 09:09:55 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 Apr 29 09:09:55 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:56 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6" returned: 0 in 0.713s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:56 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 Apr 29 09:09:56 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:56 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952" returned: 0 in 0.776s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:56 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:56 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 1G Apr 29 09:09:56 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:56 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Flow 'volume_create_manager' (16be2769-6c27-46cd-a1a3-fc317c39ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc9368e-5282-49d4-98e2-6b6c529058d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc9368e-5282-49d4-98e2-6b6c529058d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1275624981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b28170-6f5f-49a9-be13-e334ff542d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5423d1a7de4782ae9db5ff70efc133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8b47ae6c-112f-4103-9bf6-477bdac09037,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:57Z,use_quota=True,user_id='ea3a082d769b4cf2847bcb0ab38f955d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ffedd1-4a04-4062-b6bf-bf5dabbbac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ffedd1-4a04-4062-b6bf-bf5dabbbac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cc3677-4f35-4d3b-8dcb-9666fc5c7e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cc3677-4f35-4d3b-8dcb-9666fc5c7e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd9b28170-6f5f-49a9-be13-e334ff542d36', 'volume_name': 'volume-d9b28170-6f5f-49a9-be13-e334ff542d36', 'volume_size': 1, 'source_volid': '8b47ae6c-112f-4103-9bf6-477bdac09037', 'source_volstatus': 'available'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e0390d-ca3f-434f-a647-d31e1b303389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e0390d-ca3f-434f-a647-d31e1b303389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7954474-20d5-4f05-937c-516b9b8487c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:57 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Volume d9b28170-6f5f-49a9-be13-e334ff542d36: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d9b28170-6f5f-49a9-be13-e334ff542d36', 'volume_size': 1, 'source_volid': '8b47ae6c-112f-4103-9bf6-477bdac09037', 'source_volstatus': 'available'} Apr 29 09:09:57 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16" returned: 0 in 0.763s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:57 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16 Apr 29 09:09:57 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:57 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 1G" returned: 0 in 0.822s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f82f46-79a4-43bb-8dfc-be8b21165952 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:57 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f82f46-79a4-43bb-8dfc-be8b21165952 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 Apr 29 09:09:57 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:57 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6.33b177b7-ce26-414a-a915-28bf0f356a16" returned: 0 in 0.595s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-quobyte-33b177b7-ce26-414a-a915-28bf0f356a16" released by "_delete_snapshot" :: held 2.957s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-quobyte-ba3fb154-71fe-45fe-91af-ba342d6c38a6" released by "delete_snapshot" :: held 2.986s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Created reservations ['4068365b-9ca4-4b58-bed4-dd42228e6aec', 'b0b81acc-6ec3-45ee-a18b-e9987420443f', '27434435-8c94-4810-9051-a38edac08c0f', 'dc964eb4-9e8f-4766-826e-034b72b58f46'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:57 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Delete snapshot completed successfully. Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-7334655b-226b-41ab-93e0-0bc46e8a3310 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-33b177b7-ce26-414a-a915-28bf0f356a16-delete_snapshot" released by "delete_snapshot" :: held 3.129s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "cinder-ba3fb154-71fe-45fe-91af-ba342d6c38a6-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:57 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f82f46-79a4-43bb-8dfc-be8b21165952 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317" returned: 0 in 0.654s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:57 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 is being set with open permissions: ugo+rw Apr 29 09:09:57 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-ba3fb154-71fe-45fe-91af-ba342d6c38a6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:58 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 Apr 29 09:09:58 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "cinder-quobyte-ba3fb154-71fe-45fe-91af-ba342d6c38a6" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:58 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-quobyte-ba3fb154-71fe-45fe-91af-ba342d6c38a6" acquired by "delete_volume" :: waited 0.014s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:58 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[560ecba7-3ace-42f0-88ea-5c317ea8d718]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:58 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 Apr 29 09:09:58 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:58 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317" returned: 0 in 0.634s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:58 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.info Apr 29 09:09:58 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:58 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6" returned: 0 in 0.719s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:58 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:58 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6 Apr 29 09:09:58 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:59 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.info" returned: 0 in 0.615s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:59 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.info is being set with open permissions: ugo+rw Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:59 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.info Apr 29 09:09:59 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:59 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-ba3fb154-71fe-45fe-91af-ba342d6c38a6" returned: 0 in 0.617s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-quobyte-ba3fb154-71fe-45fe-91af-ba342d6c38a6" released by "delete_volume" :: held 1.397s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Created reservations ['ecd7159a-1189-4698-b59d-a9599f2fcacc', '96f27a3f-8bf2-40c2-b44e-f0294faf7ad1', '599caa72-0840-4282-a4f4-b168c14864e0', 'a7555fe8-9d48-415f-9483-f3735445e7f1'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_service.periodic_task [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83712) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:59 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:59 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:59 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:09:59 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:59 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.info" returned: 0 in 0.613s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.212s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.040s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-625185209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882d15e3-dfd8-45b9-8fad-db984a230981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbb17a13e4242428958e39cf00b77d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:54Z,use_quota=True,user_id='1955c257b59b4c83801e3b4f2255a1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Creating volume 882d15e3-dfd8-45b9-8fad-db984a230981 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:59 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:09:59 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-882d15e3-dfd8-45b9-8fad-db984a230981 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:59 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-882d15e3-dfd8-45b9-8fad-db984a230981 1073741824 Apr 29 09:09:59 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:59 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-37b05823-ed20-46d3-8fce-599b35c62966 tempest-CinderUnicodeTest-1442031092 None] Create snapshot completed successfully Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "cinder-b2e36e2d-2e51-478e-8e44-90ed20a820ed-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-b2e36e2d-2e51-478e-8e44-90ed20a820ed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "cinder-quobyte-b2e36e2d-2e51-478e-8e44-90ed20a820ed" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:00 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.807s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-0e08a72b-d46c-4cfe-b319-b73cb2a69594 None None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-quobyte-b2e36e2d-2e51-478e-8e44-90ed20a820ed" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:00 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.787s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:00 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Deleted volume successfully. Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[906113e4-5d3c-4742-965a-977e46a221e0]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-d7635983-a5a8-4d14-82b1-06e0b8421cd3 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-ba3fb154-71fe-45fe-91af-ba342d6c38a6-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:00 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed Apr 29 09:10:00 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "cinder-fa80db73-c608-47fb-9438-0b7c9c819317-delete_snapshot" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-fa80db73-c608-47fb-9438-0b7c9c819317-delete_snapshot" acquired by "delete_snapshot" :: waited 0.094s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "cinder-quobyte-39f82f46-79a4-43bb-8dfc-be8b21165952" by "delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-quobyte-39f82f46-79a4-43bb-8dfc-be8b21165952" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "cinder-quobyte-fa80db73-c608-47fb-9438-0b7c9c819317" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-quobyte-fa80db73-c608-47fb-9438-0b7c9c819317" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Deleting offline snapshot fa80db73-c608-47fb-9438-0b7c9c819317 of volume 39f82f46-79a4-43bb-8dfc-be8b21165952 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] snapshot_file for this snap is: volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e96accb-c12f-4b57-8396-5ebb2b8534a2]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:00 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 Apr 29 09:10:00 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:00 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-882d15e3-dfd8-45b9-8fad-db984a230981 1073741824" returned: 0 in 1.011s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:00 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-882d15e3-dfd8-45b9-8fad-db984a230981 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:00 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-882d15e3-dfd8-45b9-8fad-db984a230981 Apr 29 09:10:00 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:01 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed" returned: 0 in 0.797s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:01 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed Apr 29 09:10:01 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:01 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317" returned: 0 in 0.794s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39f82f46-79a4-43bb-8dfc-be8b21165952(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[670d09f0-b5aa-4687-998d-834cf0dc5940]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:01 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-882d15e3-dfd8-45b9-8fad-db984a230981" returned: 0 in 0.688s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.530s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:01 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Cloning volume 8b47ae6c-112f-4103-9bf6-477bdac09037 to volume d9b28170-6f5f-49a9-be13-e334ff542d36 Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f00a9e-9449-474a-bd18-7b404310d55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882d15e3-dfd8-45b9-8fad-db984a230981', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fb38b6-c6a9-43a1-990b-53e0ca4862c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:01 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 Apr 29 09:10:01 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:01 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume volume-882d15e3-dfd8-45b9-8fad-db984a230981 (882d15e3-dfd8-45b9-8fad-db984a230981): created successfully Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fb38b6-c6a9-43a1-990b-53e0ca4862c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Flow 'volume_create_manager' (7087772e-e3b8-44cb-af73-417463690818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Creating offline snapshot 3e149506-6043-4e26-ab94-5faa5084d79d of volume 8b47ae6c-112f-4103-9bf6-477bdac09037 {{(pid=83712) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:10:01 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ea19ca3c-d457-4de5-a887-5aae137034b3 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Created volume successfully. Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c21182-3fa1-404b-81f1-8711568c5f17]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:01 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 Apr 29 09:10:01 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:01 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-b2e36e2d-2e51-478e-8e44-90ed20a820ed" returned: 0 in 0.689s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-quobyte-b2e36e2d-2e51-478e-8e44-90ed20a820ed" released by "delete_volume" :: held 1.535s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:01 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Created reservations ['03aa1ff1-fa20-445c-8aaf-0718af7e2ff8', '56bb5b74-1966-45a4-b4ab-a746dd6b55a0', 'ff7be73a-f2b4-48d8-abb1-f7025e63f75b', '4718f050-088e-46ef-a649-2d4af3089553'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:02 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:10:02 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:02 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952" returned: 0 in 0.803s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:02 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 Apr 29 09:10:02 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:02 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037" returned: 0 in 0.865s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d 1G {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:02 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d 1G Apr 29 09:10:02 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:02 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.848s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:02 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Deleted volume successfully. Apr 29 09:10:02 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-13762c59-90fc-4f1e-aa5a-e4bfd716a138 tempest-SnapshotDependencyTests-975185021 None] Lock "cinder-b2e36e2d-2e51-478e-8e44-90ed20a820ed-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Flow 'volume_create_manager' (9fbd11cf-afff-4829-86c5-e0e3435e2af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708a2424-8047-48b1-8773-eea93975f2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708a2424-8047-48b1-8773-eea93975f2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-938215096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd95cf19-e906-4f53-a52b-e366644a5be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbb17a13e4242428958e39cf00b77d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:03Z,use_quota=True,user_id='1955c257b59b4c83801e3b4f2255a1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43fff3e-228c-44d4-838b-dc667dc95a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43fff3e-228c-44d4-838b-dc667dc95a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9c7f17-81a2-4ac7-bba9-f6a318782d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9c7f17-81a2-4ac7-bba9-f6a318782d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd95cf19-e906-4f53-a52b-e366644a5be3', 'volume_name': 'volume-dd95cf19-e906-4f53-a52b-e366644a5be3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d5519e-7156-4ba5-99d0-def0631b8004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d5519e-7156-4ba5-99d0-def0631b8004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec24f46-14bd-4c9e-b662-2a5753ceb47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:03 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume dd95cf19-e906-4f53-a52b-e366644a5be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd95cf19-e906-4f53-a52b-e366644a5be3', 'volume_size': 1} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:03 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317" returned: 0 in 1.074s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:03 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317 Apr 29 09:10:03 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Flow 'volume_create_manager' (482c269a-e15a-4279-9599-532fe3b99761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a1f7bd-8fc5-421c-b663-239914af5b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a1f7bd-8fc5-421c-b663-239914af5b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-199070439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482ae4c3-bca3-4682-9699-1b9ff50170bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbb17a13e4242428958e39cf00b77d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:04Z,use_quota=True,user_id='1955c257b59b4c83801e3b4f2255a1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:03 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfa7991-7af6-46eb-a5e6-ca0294f470ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfa7991-7af6-46eb-a5e6-ca0294f470ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d81b28f-0f44-4a49-aac3-9b1e01a98106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d81b28f-0f44-4a49-aac3-9b1e01a98106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482ae4c3-bca3-4682-9699-1b9ff50170bf', 'volume_name': 'volume-482ae4c3-bca3-4682-9699-1b9ff50170bf', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cf1306-5634-452e-b6f5-bd4a5e9018f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cf1306-5634-452e-b6f5-bd4a5e9018f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42feb4b5-94c8-4ad4-9531-71cac5bfd1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:03 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume 482ae4c3-bca3-4682-9699-1b9ff50170bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482ae4c3-bca3-4682-9699-1b9ff50170bf', 'volume_size': 1} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d 1G" returned: 0 in 1.261s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:03 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b47ae6c-112f-4103-9bf6-477bdac09037 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:03 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b47ae6c-112f-4103-9bf6-477bdac09037 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d Apr 29 09:10:03 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Flow 'volume_create_manager' (3d41f255-beee-45a2-a939-008c2eb9a9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb6196a-cec7-49db-b10f-226d19864065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb6196a-cec7-49db-b10f-226d19864065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-31893455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10f815c-afbd-40e6-b9e3-baaaea4d82a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbb17a13e4242428958e39cf00b77d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:04Z,use_quota=True,user_id='1955c257b59b4c83801e3b4f2255a1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116c1270-4fe1-436c-b557-b8c8bf46d0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116c1270-4fe1-436c-b557-b8c8bf46d0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3128b487-a475-407e-95f1-59f6c00d9702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3128b487-a475-407e-95f1-59f6c00d9702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f10f815c-afbd-40e6-b9e3-baaaea4d82a4', 'volume_name': 'volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6509056-a429-4399-a7eb-973208344848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6509056-a429-4399-a7eb-973208344848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824e9c85-e523-45df-bc5a-e9f09ba025a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:04 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume f10f815c-afbd-40e6-b9e3-baaaea4d82a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4', 'volume_size': 1} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:04 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952.fa80db73-c608-47fb-9438-0b7c9c819317" returned: 0 in 1.067s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-quobyte-fa80db73-c608-47fb-9438-0b7c9c819317" released by "_delete_snapshot" :: held 3.901s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-quobyte-39f82f46-79a4-43bb-8dfc-be8b21165952" released by "delete_snapshot" :: held 3.936s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:04 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b47ae6c-112f-4103-9bf6-477bdac09037 -F qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d" returned: 0 in 0.844s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:04 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d is being set with open permissions: ugo+rw Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Created reservations ['ae216194-f5aa-4ff5-aae8-b11c52c340e0', '0c7f5f2a-15c3-4a78-8199-fcdad13650f0', 'd5898db0-a853-459a-a286-d978699fb467', '722c5a89-803e-4e5f-a874-997a310a2a8d'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:04 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d Apr 29 09:10:04 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:04 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Delete snapshot completed successfully. Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-f6182334-74c5-4f97-8b50-c8ead984aeb2 tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-fa80db73-c608-47fb-9438-0b7c9c819317-delete_snapshot" released by "delete_snapshot" :: held 4.223s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Flow 'volume_create_manager' (3180d046-3ab6-40ec-9b69-50b3c0b49919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f363ca-9ffd-4f9f-a2ff-f50a5bc462c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f363ca-9ffd-4f9f-a2ff-f50a5bc462c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1494364922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baaa6ebf-b17d-479c-aa57-572303c7fb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbb17a13e4242428958e39cf00b77d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:05Z,use_quota=True,user_id='1955c257b59b4c83801e3b4f2255a1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911a3d4c-592e-4e8f-851f-c0592f0ada8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:04 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911a3d4c-592e-4e8f-851f-c0592f0ada8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3816fae6-c3cd-47ce-b6b0-968dfd6316ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3816fae6-c3cd-47ce-b6b0-968dfd6316ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baaa6ebf-b17d-479c-aa57-572303c7fb70', 'volume_name': 'volume-baaa6ebf-b17d-479c-aa57-572303c7fb70', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05559fba-7a02-4dfe-8407-a18674a106a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05559fba-7a02-4dfe-8407-a18674a106a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2feb69ca-a64f-4f5f-92e0-7dcee4b01a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:05 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume baaa6ebf-b17d-479c-aa57-572303c7fb70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baaa6ebf-b17d-479c-aa57-572303c7fb70', 'volume_size': 1} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83712) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Flow 'volume_create_manager' (a46597a3-93f1-428c-8086-31e6669816bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ad73dd-270e-47d4-9314-e4c749b6be5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ad73dd-270e-47d4-9314-e4c749b6be5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1273027950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a02b810-ebe9-4759-aba2-7b8cb0949c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbb17a13e4242428958e39cf00b77d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:05Z,use_quota=True,user_id='1955c257b59b4c83801e3b4f2255a1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db25de3c-34da-4315-ab6e-2be4fc4aab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db25de3c-34da-4315-ab6e-2be4fc4aab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3f87d7-d456-463d-8dd0-6d5a44f7cd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3f87d7-d456-463d-8dd0-6d5a44f7cd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a02b810-ebe9-4759-aba2-7b8cb0949c1a', 'volume_name': 'volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16adc69-6b47-4ce0-bea7-c2a7f6b2ae09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16adc69-6b47-4ce0-bea7-c2a7f6b2ae09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdfc581-bad0-407b-8827-0b9c92a9aff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:05 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume 9a02b810-ebe9-4759-aba2-7b8cb0949c1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a', 'volume_size': 1} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:05 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d" returned: 0 in 0.726s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:05 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.info Apr 29 09:10:05 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "cinder-39f82f46-79a4-43bb-8dfc-be8b21165952-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:05 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-39f82f46-79a4-43bb-8dfc-be8b21165952-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "cinder-quobyte-39f82f46-79a4-43bb-8dfc-be8b21165952" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-quobyte-39f82f46-79a4-43bb-8dfc-be8b21165952" acquired by "delete_volume" :: waited 0.018s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aac6655-d929-4a9b-bbff-83ac3f55f719]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:06 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.info" returned: 0 in 0.689s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:06 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.info is being set with open permissions: ugo+rw Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.info {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:06 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.info Apr 29 09:10:06 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:06 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 Apr 29 09:10:06 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:06 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.info" returned: 0 in 0.747s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-quobyte-d9b28170-6f5f-49a9-be13-e334ff542d36" by "_copy_volume_from_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-d9b28170-6f5f-49a9-be13-e334ff542d36" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] snapshot: 3e149506-6043-4e26-ab94-5faa5084d79d, volume: d9b28170-6f5f-49a9-be13-e334ff542d36, {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:10:06 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952" returned: 0 in 0.886s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e362e9-272f-403c-8244-9596d17e9c7c]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:06 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:07 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952 Apr 29 09:10:07 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:07 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d Apr 29 09:10:07 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:07 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-39f82f46-79a4-43bb-8dfc-be8b21165952" returned: 0 in 0.729s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-quobyte-39f82f46-79a4-43bb-8dfc-be8b21165952" released by "delete_volume" :: held 1.697s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Created reservations ['37d42194-fb38-4e38-9802-4fef0124a75d', 'c14a03b8-d5ed-4d1e-ac2f-7d938f2cf102', '6e3e5e6a-5e33-4686-86b2-e907929f72ce', '1b0bb75c-9790-4653-aaa5-0334fa13fd0d'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:07 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d" returned: 0 in 0.891s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b47ae6c-112f-4103-9bf6-477bdac09037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Creating direct copy from snapshot {{(pid=83712) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:10:07 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:10:07 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf7e461-5307-4340-8fea-11dad5b412cb]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:07 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:08 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 Apr 29 09:10:08 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "cinder-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "cinder-quobyte-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-quobyte-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c" acquired by "delete_volume" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:08 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[5751c4bb-e6e6-48f6-8be9-c1291fa2444e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:08 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c Apr 29 09:10:08 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:08 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.705s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:08 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:08 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Deleted volume successfully. Apr 29 09:10:08 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e926beaf-32f8-4937-bfd3-02d06a77d764 tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-39f82f46-79a4-43bb-8dfc-be8b21165952-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:08 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037" returned: 0 in 0.912s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:08 devstack cinder-volume[83712]: DEBUG cinder.utils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Path /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36 not found in is_blk_device check {{(pid=83712) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:10:08 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:08 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36 Apr 29 09:10:08 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:09 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c" returned: 0 in 0.831s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:09 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:09 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c Apr 29 09:10:09 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:10 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c" returned: 0 in 0.839s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:10 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-quobyte-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c" released by "delete_volume" :: held 1.735s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:10 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Created reservations ['d3ae1013-428e-4fc1-a4b9-1adeeba76339', '8626f210-e916-4aae-baac-73a299f1cb7d', 'b9175b56-966e-456d-bc2a-57ffa757ca62', '1066343c-2bee-49cc-9e5a-253cb81e3793'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:10 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:10 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:10 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:10:10 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:11 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:11 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 1.346s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:11 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:11 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Deleted volume successfully. Apr 29 09:10:11 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-cb2465fc-b2ee-42ee-bb33-5c0de1f27cab tempest-CinderUnicodeTest-1442031092 None] Lock "cinder-1b3cf4b6-2b19-44e7-9074-3842a81fbe7c-delete_volume" released by "delete_volume" :: held 3.614s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:15 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36" returned: 0 in 6.689s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:15 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fa5822-b258-4202-9631-21d1659ec746]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:15 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:15 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 Apr 29 09:10:15 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:16 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037" returned: 0 in 1.006s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:16 devstack cinder-volume[83712]: DEBUG cinder.image.image_utils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36 {{(pid=83712) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:10:16 devstack cinder-volume[83712]: INFO cinder.image.image_utils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Converted 1024.00 MB image at 153.06 MB/s Apr 29 09:10:16 devstack cinder-volume[83712]: WARNING cinder.volume.drivers.remotefs [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36 is being set with open permissions: ugo+rw Apr 29 09:10:16 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:16 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36 Apr 29 09:10:16 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:17 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36" returned: 0 in 0.688s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-d9b28170-6f5f-49a9-be13-e334ff542d36" released by "_copy_volume_from_snapshot" :: held 10.282s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-quobyte-3e149506-6043-4e26-ab94-5faa5084d79d" by "_delete_snapshot" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:17 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-3e149506-6043-4e26-ab94-5faa5084d79d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Deleting offline snapshot 3e149506-6043-4e26-ab94-5faa5084d79d of volume 8b47ae6c-112f-4103-9bf6-477bdac09037 {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:10:17 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] snapshot_file for this snap is: volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d {{(pid=83712) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:10:17 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[4143851a-4f2e-4872-a914-80f04a164ca7]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:17 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:17 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d Apr 29 09:10:17 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:18 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d" returned: 0 in 0.770s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:18 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b47ae6c-112f-4103-9bf6-477bdac09037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83712) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:18 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2d43f4-62fa-4f23-95c8-dec846107c53]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:18 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 Apr 29 09:10:18 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:18 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037" returned: 0 in 0.691s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:18 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:18 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d Apr 29 09:10:18 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:19 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d" returned: 0 in 0.663s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:19 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:19 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d Apr 29 09:10:19 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:20 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037.3e149506-6043-4e26-ab94-5faa5084d79d" returned: 0 in 0.589s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-3e149506-6043-4e26-ab94-5faa5084d79d" released by "_delete_snapshot" :: held 2.802s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.440s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.839s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-938215096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd95cf19-e906-4f53-a52b-e366644a5be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbb17a13e4242428958e39cf00b77d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:03Z,use_quota=True,user_id='1955c257b59b4c83801e3b4f2255a1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Creating volume dd95cf19-e906-4f53-a52b-e366644a5be3 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:10:20 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-dd95cf19-e906-4f53-a52b-e366644a5be3 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:20 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-dd95cf19-e906-4f53-a52b-e366644a5be3 1073741824 Apr 29 09:10:20 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7954474-20d5-4f05-937c-516b9b8487c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b28170-6f5f-49a9-be13-e334ff542d36', 'volume_size': 1, 'source_volid': '8b47ae6c-112f-4103-9bf6-477bdac09037', 'source_volstatus': 'available'}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ccbfb0f-faf9-4c38-9bfb-839267d1f91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:20 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Volume volume-d9b28170-6f5f-49a9-be13-e334ff542d36 (d9b28170-6f5f-49a9-be13-e334ff542d36): created successfully Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ccbfb0f-faf9-4c38-9bfb-839267d1f91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:20 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Flow 'volume_create_manager' (16be2769-6c27-46cd-a1a3-fc317c39ab51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:20 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-de4c0ec5-a4b8-453a-b136-08f9cf87ef1e tempest-VolumeDependencyTests-291119355 None] Created volume successfully. Apr 29 09:10:20 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:20 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-dd95cf19-e906-4f53-a52b-e366644a5be3 Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-dd95cf19-e906-4f53-a52b-e366644a5be3 1073741824" returned: 0 in 0.787s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-dd95cf19-e906-4f53-a52b-e366644a5be3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:20 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-8b47ae6c-112f-4103-9bf6-477bdac09037-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Lock "cinder-8b47ae6c-112f-4103-9bf6-477bdac09037-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-quobyte-8b47ae6c-112f-4103-9bf6-477bdac09037" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-8b47ae6c-112f-4103-9bf6-477bdac09037" acquired by "delete_volume" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcd2bae-c64e-48f6-857d-3213b62d9b6a]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:21 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 Apr 29 09:10:21 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:21 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-dd95cf19-e906-4f53-a52b-e366644a5be3" returned: 0 in 0.619s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.711s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-199070439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482ae4c3-bca3-4682-9699-1b9ff50170bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbb17a13e4242428958e39cf00b77d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:04Z,use_quota=True,user_id='1955c257b59b4c83801e3b4f2255a1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Creating volume 482ae4c3-bca3-4682-9699-1b9ff50170bf {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:10:21 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-482ae4c3-bca3-4682-9699-1b9ff50170bf 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec24f46-14bd-4c9e-b662-2a5753ceb47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd95cf19-e906-4f53-a52b-e366644a5be3', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:21 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-482ae4c3-bca3-4682-9699-1b9ff50170bf 1073741824 Apr 29 09:10:21 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db62c95-71cb-492e-832c-bdef30c24603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:21 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume volume-dd95cf19-e906-4f53-a52b-e366644a5be3 (dd95cf19-e906-4f53-a52b-e366644a5be3): created successfully Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db62c95-71cb-492e-832c-bdef30c24603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:21 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Flow 'volume_create_manager' (9fbd11cf-afff-4829-86c5-e0e3435e2af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:21 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-147cc467-2d51-42a5-98c3-ebec3d8cb722 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Created volume successfully. Apr 29 09:10:22 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037" returned: 0 in 0.733s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:22 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037 Apr 29 09:10:22 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:22 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-482ae4c3-bca3-4682-9699-1b9ff50170bf 1073741824" returned: 0 in 0.810s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-482ae4c3-bca3-4682-9699-1b9ff50170bf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:22 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-482ae4c3-bca3-4682-9699-1b9ff50170bf Apr 29 09:10:22 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:22 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-8b47ae6c-112f-4103-9bf6-477bdac09037" returned: 0 in 0.683s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-8b47ae6c-112f-4103-9bf6-477bdac09037" released by "delete_volume" :: held 1.490s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Created reservations ['ced025e0-9b77-4242-ba5a-7245968dd4e6', 'e89af34b-d863-4df2-91aa-6b997f6b480f', '183778b6-428e-4725-b074-2897fce00c7e', 'c0443d09-b2fb-45e1-abe3-a28bf40c2a53'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:22 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:22 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:10:22 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:23 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-482ae4c3-bca3-4682-9699-1b9ff50170bf" returned: 0 in 0.595s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.716s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-31893455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10f815c-afbd-40e6-b9e3-baaaea4d82a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbb17a13e4242428958e39cf00b77d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:04Z,use_quota=True,user_id='1955c257b59b4c83801e3b4f2255a1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Creating volume f10f815c-afbd-40e6-b9e3-baaaea4d82a4 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:10:23 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42feb4b5-94c8-4ad4-9531-71cac5bfd1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482ae4c3-bca3-4682-9699-1b9ff50170bf', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f018348-af6f-49de-a1c5-c44ac0e1e6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:23 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4 1073741824 Apr 29 09:10:23 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:23 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume volume-482ae4c3-bca3-4682-9699-1b9ff50170bf (482ae4c3-bca3-4682-9699-1b9ff50170bf): created successfully Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f018348-af6f-49de-a1c5-c44ac0e1e6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Flow 'volume_create_manager' (482c269a-e15a-4279-9599-532fe3b99761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:23 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-bc9a1c33-dc71-4b6a-a0e6-4484f708e572 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Created volume successfully. Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-d9b28170-6f5f-49a9-be13-e334ff542d36-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Lock "cinder-d9b28170-6f5f-49a9-be13-e334ff542d36-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-quobyte-d9b28170-6f5f-49a9-be13-e334ff542d36" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:23 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.649s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-d9b28170-6f5f-49a9-be13-e334ff542d36" acquired by "delete_volume" :: waited 0.022s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:23 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Deleted volume successfully. Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[c392a8fa-f6ff-4bfb-a348-5990529bb524]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ca4a62a1-1089-447a-a5d6-7f15fd3039ef tempest-VolumeDependencyTests-291119355 None] Lock "cinder-8b47ae6c-112f-4103-9bf6-477bdac09037-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:23 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36 Apr 29 09:10:23 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:23 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4 1073741824" returned: 0 in 0.860s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:23 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:23 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4 Apr 29 09:10:23 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:24 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36" returned: 0 in 0.754s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:24 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36 Apr 29 09:10:24 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:24 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4" returned: 0 in 0.655s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.590s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1494364922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baaa6ebf-b17d-479c-aa57-572303c7fb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbb17a13e4242428958e39cf00b77d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:05Z,use_quota=True,user_id='1955c257b59b4c83801e3b4f2255a1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Creating volume baaa6ebf-b17d-479c-aa57-572303c7fb70 {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:10:24 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-baaa6ebf-b17d-479c-aa57-572303c7fb70 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:24 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-baaa6ebf-b17d-479c-aa57-572303c7fb70 1073741824 Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824e9c85-e523-45df-bc5a-e9f09ba025a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:24 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0044b6-6bd1-4e77-863e-a160a1dc2aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:24 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4 (f10f815c-afbd-40e6-b9e3-baaaea4d82a4): created successfully Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0044b6-6bd1-4e77-863e-a160a1dc2aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Flow 'volume_create_manager' (3d41f255-beee-45a2-a939-008c2eb9a9c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:24 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-62d2c514-28d8-45e6-ab35-e4402348a321 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Created volume successfully. Apr 29 09:10:24 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-d9b28170-6f5f-49a9-be13-e334ff542d36" returned: 0 in 0.617s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:24 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-d9b28170-6f5f-49a9-be13-e334ff542d36" released by "delete_volume" :: held 1.429s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Created reservations ['8575950f-5f9b-4202-b968-25024275985a', '47c6a2ac-5863-41d8-8b3b-0ce4d6142c5d', 'fc1fcb06-17fb-4ffb-8cf7-b52d4e3b9631', '713fec8f-44ae-44ea-a4c7-cb1efc968f29'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:25 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:10:25 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:25 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-baaa6ebf-b17d-479c-aa57-572303c7fb70 1073741824" returned: 0 in 0.837s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-baaa6ebf-b17d-479c-aa57-572303c7fb70 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:25 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-baaa6ebf-b17d-479c-aa57-572303c7fb70 Apr 29 09:10:25 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:25 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.629s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:25 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Deleted volume successfully. Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-e12da8c1-c535-400e-ad86-b7bed916bd86-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Lock "cinder-e12da8c1-c535-400e-ad86-b7bed916bd86-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ff4d3773-50a7-4ff3-9166-4ed889b25a2b tempest-VolumeDependencyTests-291119355 None] Lock "cinder-d9b28170-6f5f-49a9-be13-e334ff542d36-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Acquiring lock "cinder-quobyte-e12da8c1-c535-400e-ad86-b7bed916bd86" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-e12da8c1-c535-400e-ad86-b7bed916bd86" acquired by "delete_volume" :: waited 0.015s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aed7d9-d16e-4115-9cf8-93f05a31fd17]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:25 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:25 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86 Apr 29 09:10:25 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:26 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-baaa6ebf-b17d-479c-aa57-572303c7fb70" returned: 0 in 0.709s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.785s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1273027950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a02b810-ebe9-4759-aba2-7b8cb0949c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbb17a13e4242428958e39cf00b77d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:05Z,use_quota=True,user_id='1955c257b59b4c83801e3b4f2255a1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302e8418-e2fd-489d-8b16-70b7b273bbc9),volume_type_id=302e8418-e2fd-489d-8b16-70b7b273bbc9)}" {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.remotefs [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Creating volume 9a02b810-ebe9-4759-aba2-7b8cb0949c1a {{(pid=83712) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Selected osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa as target Quobyte volume. {{(pid=83712) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:10:26 devstack cinder-volume[83712]: INFO cinder.volume.drivers.remotefs [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] casted to osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a 1073741824 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2feb69ca-a64f-4f5f-92e0-7dcee4b01a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baaa6ebf-b17d-479c-aa57-572303c7fb70', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4ce198-e397-4c78-a334-efbc1d460e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:26 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a 1073741824 Apr 29 09:10:26 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:26 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume volume-baaa6ebf-b17d-479c-aa57-572303c7fb70 (baaa6ebf-b17d-479c-aa57-572303c7fb70): created successfully Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4ce198-e397-4c78-a334-efbc1d460e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Flow 'volume_create_manager' (3180d046-3ab6-40ec-9b69-50b3c0b49919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:26 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-c88f12a2-ce62-43b4-83d7-8fdc420c2d6c tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Created volume successfully. Apr 29 09:10:26 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86" returned: 0 in 0.792s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:26 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:26 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86 Apr 29 09:10:26 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:27 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a 1073741824" returned: 0 in 0.945s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:27 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a Apr 29 09:10:27 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:27 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-e12da8c1-c535-400e-ad86-b7bed916bd86" returned: 0 in 0.703s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Lock "cinder-quobyte-e12da8c1-c535-400e-ad86-b7bed916bd86" released by "delete_volume" :: held 1.549s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Created reservations ['6be41458-dfa4-482a-b62f-cdcbded71ca8', 'be3ed948-6ab8-4109-90c7-8779d9885004', '5fa69fef-8c16-42e7-a50d-8ace470665e0', '3279af21-93de-4754-aff2-e13a331e21a7'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:27 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:10:27 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:27 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a" returned: 0 in 0.715s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'} {{(pid=83712) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdfc581-bad0-407b-8827-0b9c92a9aff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a', 'volume_size': 1}' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67534f3f-2cf5-4f2a-acd6-5d54d0b3cc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:27 devstack cinder-volume[83712]: INFO cinder.volume.flows.manager.create_volume [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Volume volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a (9a02b810-ebe9-4759-aba2-7b8cb0949c1a): created successfully Apr 29 09:10:27 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67534f3f-2cf5-4f2a-acd6-5d54d0b3cc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83712) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:28 devstack cinder-volume[83712]: DEBUG cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Flow 'volume_create_manager' (a46597a3-93f1-428c-8086-31e6669816bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83712) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:28 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-21c88932-5ed9-4430-bfaf-9d1593983a34 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Created volume successfully. Apr 29 09:10:28 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.701s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:28 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:28 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Deleted volume successfully. Apr 29 09:10:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-a053153f-e0c4-470b-871e-2d0a0c94120b tempest-VolumeDependencyTests-291119355 None] Lock "cinder-e12da8c1-c535-400e-ad86-b7bed916bd86-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "cinder-9a02b810-ebe9-4759-aba2-7b8cb0949c1a-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-9a02b810-ebe9-4759-aba2-7b8cb0949c1a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "cinder-quobyte-9a02b810-ebe9-4759-aba2-7b8cb0949c1a" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:28 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-quobyte-9a02b810-ebe9-4759-aba2-7b8cb0949c1a" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:28 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2699ff-85db-4794-b3d9-4d5f4f7d501e]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:28 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:28 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a Apr 29 09:10:28 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:29 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a" returned: 0 in 0.890s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:29 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:29 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a Apr 29 09:10:29 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:30 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-9a02b810-ebe9-4759-aba2-7b8cb0949c1a" returned: 0 in 0.597s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-quobyte-9a02b810-ebe9-4759-aba2-7b8cb0949c1a" released by "delete_volume" :: held 1.547s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Created reservations ['c92bfd0e-2d2b-4c17-97dd-82df7b38b7fc', '41a9fd61-f084-4d09-912e-fbd5680301d0', '199f0a79-9875-4858-919a-93aa09571852', '1a0025c4-c59c-492d-a036-36da38f773b2'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:30 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:10:30 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "cinder-baaa6ebf-b17d-479c-aa57-572303c7fb70-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-baaa6ebf-b17d-479c-aa57-572303c7fb70-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "cinder-quobyte-baaa6ebf-b17d-479c-aa57-572303c7fb70" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:30 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-quobyte-baaa6ebf-b17d-479c-aa57-572303c7fb70" acquired by "delete_volume" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:31 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[719748aa-ba13-4b60-b7e4-ec9645dfe970]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-baaa6ebf-b17d-479c-aa57-572303c7fb70 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:31 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.631s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:31 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:31 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Deleted volume successfully. Apr 29 09:10:31 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-ab528ce4-7f1f-4c59-b190-de290d75d2f6 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-9a02b810-ebe9-4759-aba2-7b8cb0949c1a-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:31 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-baaa6ebf-b17d-479c-aa57-572303c7fb70 Apr 29 09:10:31 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:31 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-baaa6ebf-b17d-479c-aa57-572303c7fb70" returned: 0 in 0.795s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:31 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-baaa6ebf-b17d-479c-aa57-572303c7fb70 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:31 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-baaa6ebf-b17d-479c-aa57-572303c7fb70 Apr 29 09:10:31 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:32 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-baaa6ebf-b17d-479c-aa57-572303c7fb70" returned: 0 in 0.658s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:32 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-quobyte-baaa6ebf-b17d-479c-aa57-572303c7fb70" released by "delete_volume" :: held 1.497s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:32 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Created reservations ['6ba679fe-5716-4b11-85db-9603f587d56d', '3e52b10c-875f-46e8-af38-cbf0805a3ef4', '4a5a9abc-5df2-45fd-adfb-2939ec4af09a', '487c8b55-849c-47ae-8ab1-78ef207f60d3'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:32 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:32 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:32 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:32 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:10:32 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:33 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "cinder-f10f815c-afbd-40e6-b9e3-baaaea4d82a4-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:33 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-f10f815c-afbd-40e6-b9e3-baaaea4d82a4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:33 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "cinder-quobyte-f10f815c-afbd-40e6-b9e3-baaaea4d82a4" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:33 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-quobyte-f10f815c-afbd-40e6-b9e3-baaaea4d82a4" acquired by "delete_volume" :: waited 0.019s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:33 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7b26ed-aa78-4e3e-bdae-bbf600863c46]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:33 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:33 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.755s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:33 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:33 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Deleted volume successfully. Apr 29 09:10:33 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-e1219824-ed41-42ae-9643-2cd4c8c71063 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-baaa6ebf-b17d-479c-aa57-572303c7fb70-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:33 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4 Apr 29 09:10:33 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:34 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4" returned: 0 in 0.789s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:34 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4 Apr 29 09:10:34 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:34 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-f10f815c-afbd-40e6-b9e3-baaaea4d82a4" returned: 0 in 0.664s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:34 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-quobyte-f10f815c-afbd-40e6-b9e3-baaaea4d82a4" released by "delete_volume" :: held 1.499s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:34 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Created reservations ['80682d11-0e26-4ff7-b451-ae69726bcda2', 'bded362f-f485-476b-ac2f-f51f24029373', 'c93cb59f-ebde-4cc1-ac42-c4f1f422bf27', 'f057780c-25bd-47f8-8e15-b574279fc95b'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:34 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:34 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:34 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:10:34 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "cinder-482ae4c3-bca3-4682-9699-1b9ff50170bf-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-482ae4c3-bca3-4682-9699-1b9ff50170bf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "cinder-quobyte-482ae4c3-bca3-4682-9699-1b9ff50170bf" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-quobyte-482ae4c3-bca3-4682-9699-1b9ff50170bf" acquired by "delete_volume" :: waited 0.023s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:35 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[5261b779-7023-496c-b3f5-ba1633f2d786]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-482ae4c3-bca3-4682-9699-1b9ff50170bf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:35 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:35 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.742s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:35 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:35 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Deleted volume successfully. Apr 29 09:10:35 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-482ae4c3-bca3-4682-9699-1b9ff50170bf Apr 29 09:10:35 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:35 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-8dd03cec-cd11-487a-bf22-f70d73fcc695 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-f10f815c-afbd-40e6-b9e3-baaaea4d82a4-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:36 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-482ae4c3-bca3-4682-9699-1b9ff50170bf" returned: 0 in 0.804s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-482ae4c3-bca3-4682-9699-1b9ff50170bf {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:36 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-482ae4c3-bca3-4682-9699-1b9ff50170bf Apr 29 09:10:36 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:36 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:36 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-482ae4c3-bca3-4682-9699-1b9ff50170bf" returned: 0 in 0.620s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:36 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-quobyte-482ae4c3-bca3-4682-9699-1b9ff50170bf" released by "delete_volume" :: held 1.476s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Created reservations ['64a3fdd7-3d37-4a74-a9fb-1ea904b3f04b', 'ac560937-d381-47fd-a978-d10e729c8dc9', 'b84dd0e3-5141-4ada-8eb9-f7f48943d505', '705f42eb-c4b5-46f1-9677-876e38be93e9'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:37 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:10:37 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "cinder-dd95cf19-e906-4f53-a52b-e366644a5be3-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-dd95cf19-e906-4f53-a52b-e366644a5be3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "cinder-quobyte-dd95cf19-e906-4f53-a52b-e366644a5be3" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-quobyte-dd95cf19-e906-4f53-a52b-e366644a5be3" acquired by "delete_volume" :: waited 0.017s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a648cca-4458-4a73-b383-14dfcd664c29]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-dd95cf19-e906-4f53-a52b-e366644a5be3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:37 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.646s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:37 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Deleted volume successfully. Apr 29 09:10:37 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-5b35a83d-ee59-4f85-8a1c-c018c8743131 tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-482ae4c3-bca3-4682-9699-1b9ff50170bf-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:37 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-dd95cf19-e906-4f53-a52b-e366644a5be3 Apr 29 09:10:37 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:38 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-dd95cf19-e906-4f53-a52b-e366644a5be3" returned: 0 in 0.784s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:38 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-dd95cf19-e906-4f53-a52b-e366644a5be3 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:38 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-dd95cf19-e906-4f53-a52b-e366644a5be3 Apr 29 09:10:38 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:39 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-dd95cf19-e906-4f53-a52b-e366644a5be3" returned: 0 in 0.668s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-quobyte-dd95cf19-e906-4f53-a52b-e366644a5be3" released by "delete_volume" :: held 1.496s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Created reservations ['084d8eb0-0879-47cd-bb21-2f476eb2fc01', '4ae4a60a-fe4a-4eaf-82c6-729040251bda', '10921c15-cb2c-42ec-994e-73470a683aab', '093a2ee4-0df0-4889-8fb5-0ec4b9d3c352'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:39 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:10:39 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "cinder-882d15e3-dfd8-45b9-8fad-db984a230981-delete_volume" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-882d15e3-dfd8-45b9-8fad-db984a230981-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "cinder-quobyte-882d15e3-dfd8-45b9-8fad-db984a230981" by "delete_volume" {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-quobyte-882d15e3-dfd8-45b9-8fad-db984a230981" acquired by "delete_volume" :: waited 0.018s {{(pid=83712) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f21101-753b-4faa-bef1-1e4e92f7c8c3]: (4, 'qcow2') {{(pid=85293) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:39 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-882d15e3-dfd8-45b9-8fad-db984a230981 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:40 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.698s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:40 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:40 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Deleted volume successfully. Apr 29 09:10:40 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-330cc270-4f99-4ff5-b4b7-679f6709447b tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-dd95cf19-e906-4f53-a52b-e366644a5be3-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:40 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-882d15e3-dfd8-45b9-8fad-db984a230981 Apr 29 09:10:40 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:40 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-882d15e3-dfd8-45b9-8fad-db984a230981" returned: 0 in 0.781s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:40 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-882d15e3-dfd8-45b9-8fad-db984a230981 {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:40 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-882d15e3-dfd8-45b9-8fad-db984a230981 Apr 29 09:10:40 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:41 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce/volume-882d15e3-dfd8-45b9-8fad-db984a230981" returned: 0 in 0.633s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:41 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-quobyte-882d15e3-dfd8-45b9-8fad-db984a230981" released by "delete_volume" :: held 1.461s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:41 devstack cinder-volume[83712]: DEBUG cinder.quota [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Created reservations ['d32637be-717e-4135-bb68-3f988e48f645', '2c72faae-cbb1-45dd-ba1b-8f916e9863a9', 'c988bf71-4f05-4a64-b6a6-1f2e80200391', '4494f635-f799-4788-8bf2-df05418e449a'] {{(pid=83712) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa': None} {{(pid=83712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:41 devstack cinder-volume[83712]: DEBUG cinder.volume.drivers.quobyte [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847b07f3-4f35-4cfe-a830-d362cb0358fa'] {{(pid=83712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.lockutils [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:41 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:41 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce Apr 29 09:10:41 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:42 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:42 devstack cinder-volume[83712]: DEBUG oslo_concurrency.processutils [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0257eb115692b30d5f6066d63e740ce" returned: 0 in 0.653s {{(pid=83712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:42 devstack cinder-volume[83712]: DEBUG cinder.manager [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Notifying Schedulers of capabilities ... {{(pid=83712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:42 devstack cinder-volume[83712]: INFO cinder.volume.manager [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Deleted volume successfully. Apr 29 09:10:42 devstack cinder-volume[83712]: DEBUG cinder.coordination [None req-1fe0dede-178f-4858-a702-09b21382d4ac tempest-CreateVolumesFromSourceVolumeTest-2026720494 None] Lock "cinder-882d15e3-dfd8-45b9-8fad-db984a230981-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=83712) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:51 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:UPDATE=142,cinder:SELECT=90,cinder:INSERT=33,cinder:DELETE=13 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:10:52 devstack cinder-volume[83712]: DEBUG dbcounter [-] [83712] Writing DB stats cinder:SELECT=105,cinder:UPDATE=143,cinder:DELETE=10,cinder:INSERT=38 {{(pid=83712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}